-- Logs begin at Thu 2021-10-28 14:22:39 UTC, end at Thu 2021-10-28 16:09:35 UTC. -- Oct 28 15:08:50.260106 dv-cinder-783643-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 15:08:50.267697 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 15:08:50 2021] *** Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: nodename: dv-cinder-783643-3-iscsi Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: machine: x86_64 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: clock source: unix Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: pcre jit disabled Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: detected number of CPU cores: 4 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: current working directory: / Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: detected binary path: /usr/bin/uwsgi-core Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: your processes number limit is 47680 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: your memory page size is 4096 bytes Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: detected max file descriptor number: 2048 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: lock engine: pthread robust mutexes Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: thunder lock: enabled Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 15:08:50.272277 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 15:08:50.315170 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: Python main interpreter initialized at 0x55c190cef9c0 Oct 28 15:08:50.315170 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: python threads support enabled Oct 28 15:08:50.315170 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: your server socket listen backlog is limited to 100 connections Oct 28 15:08:50.315170 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: your mercy for graceful operations on workers is 90 seconds Oct 28 15:08:50.315519 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 15:08:50.315594 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: *** Operational MODE: preforking *** Oct 28 15:08:50.315839 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: *** uWSGI is running in multiple interpreter mode *** Oct 28 15:08:50.315839 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: spawned uWSGI master process (pid: 101456) Oct 28 15:08:50.316104 dv-cinder-783643-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 15:08:50.320413 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: spawned uWSGI worker 1 (pid: 101457, cores: 1) Oct 28 15:08:50.320413 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: spawned uWSGI worker 2 (pid: 101458, cores: 1) Oct 28 15:08:50.320413 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 15:08:51.946188 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:08:51.946188 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: from cryptography.utils import int_from_bytes Oct 28 15:08:51.946854 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:08:51.946854 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: from cryptography.utils import int_from_bytes Oct 28 15:08:51.951493 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:08:51.951493 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: from cryptography.utils import int_from_bytes Oct 28 15:08:51.951988 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:08:51.951988 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: from cryptography.utils import int_from_bytes Oct 28 15:08:54.576101 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 15:08:54.576678 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 15:08:54.577037 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 15:08:54.577142 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 15:08:54.577235 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 15:08:54.577320 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 15:08:54.577403 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 15:08:54.577490 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 15:08:54.577568 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 15:08:54.577655 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 15:08:54.577806 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.577900 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578131 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578219 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578453 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578550 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578771 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.578881 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579105 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579207 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579412 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579506 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579730 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.579815 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580043 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580187 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580368 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580533 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580646 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580738 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.580958 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581054 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581279 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-783643-3-iscsi {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581364 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-783643-3-iscsi {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581594 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581687 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581897 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.581989 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.582762 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.582903 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583074 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583169 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583376 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583469 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583692 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583782 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.583992 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.584076 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.584517 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.584633 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.584941 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585114 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585254 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585417 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585566 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585776 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.585921 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586055 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586194 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586337 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586430 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586517 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586744 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.586836 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587048 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587138 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587364 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587454 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587670 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.587769 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588061 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-783643-3-iscsi {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588162 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-783643-3-iscsi {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588411 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588517 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588706 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.588796 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589020 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589146 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589429 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589524 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589737 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.589837 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590043 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590150 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590364 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590462 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590681 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590777 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.590983 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591075 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591308 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591400 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591626 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591727 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.591942 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592037 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592259 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592344 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592581 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592677 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592888 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.592972 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593192 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593283 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593509 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593605 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593811 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.593902 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594111 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594194 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594357 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594450 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594662 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594754 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.594981 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595071 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595297 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595389 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595614 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595707 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595863 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.595961 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596108 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596195 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596439 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596540 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596759 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.596853 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597061 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597153 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597364 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597457 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597686 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.597777 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598012 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598170 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598317 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598486 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598622 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598791 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.598926 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599098 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599233 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599402 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599532 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599719 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.599842 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600033 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600160 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600361 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600537 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600683 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.600796 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601001 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601192 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601396 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601489 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601645 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601735 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.601951 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602036 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602287 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602381 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602605 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602691 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.602912 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603042 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603232 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603319 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603551 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603644 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603853 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.603943 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604155 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604240 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604482 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604573 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604803 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.604896 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605105 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605195 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605354 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605441 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605658 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605753 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.605955 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606038 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606258 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606342 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606561 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606654 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606867 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.606958 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607169 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607253 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607469 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607563 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607766 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.607855 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608069 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608160 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608374 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608573 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608701 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.608785 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609004 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609096 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609305 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609398 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609608 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609699 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609909 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.609993 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610210 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610296 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610513 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610646 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610831 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.610913 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611136 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611229 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611440 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611533 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611742 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.611826 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612042 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612132 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612346 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612478 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612678 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612763 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.612981 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613066 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613307 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613407 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613623 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613716 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.613924 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614016 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614227 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614311 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614537 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614621 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614841 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.614936 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615146 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615239 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615443 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615538 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615746 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.615832 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616049 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616135 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616352 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616468 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616677 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616773 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.616977 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617063 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617274 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617365 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617572 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617666 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617869 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.617968 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618165 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618257 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618466 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618552 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618762 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.618847 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619055 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619152 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619367 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619459 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619669 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619752 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.619976 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620070 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620278 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620368 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620611 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620750 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.620944 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.621030 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:08:54.621277 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.621362 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.621604 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.621695 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.621920 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622004 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622244 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622329 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622574 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622658 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622889 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.622981 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623202 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623331 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623509 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623605 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623820 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.623905 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624129 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624223 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624464 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624566 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624775 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.624859 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625087 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625188 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625400 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625495 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625712 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.625805 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626029 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626121 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626342 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626434 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626656 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626751 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.626965 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627050 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627270 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627362 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627584 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627668 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627900 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.627996 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.628212 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.628306 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.628550 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.628638 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.628893 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.629518 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.629747 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.629862 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630060 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630145 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630374 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630468 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630682 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.630806 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631001 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631091 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631311 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631395 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631625 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631719 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.631934 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632026 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632258 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632348 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632594 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632683 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632908 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.632999 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633235 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633337 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633550 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633645 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633853 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.633936 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634154 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634250 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634458 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634542 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634758 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.634842 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635064 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635156 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635365 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635455 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635683 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635775 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.635989 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636081 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636300 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636383 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636643 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636729 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.636946 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637031 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637254 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637338 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637559 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637643 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637861 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.637953 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638170 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638253 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638474 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638560 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638774 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.638859 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639093 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639185 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639399 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639483 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639701 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.639795 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640014 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640097 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640314 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640445 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640647 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640733 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.640958 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641044 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641265 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641361 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641573 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641657 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.641881 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.642222 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.642450 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.642544 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.642761 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.642883 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643069 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643159 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643399 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643539 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643701 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.643787 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.644018 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.644110 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.644340 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.644470 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645230 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645331 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645536 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645621 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645837 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.645922 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646140 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646233 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646442 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646527 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646745 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.646836 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647046 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647130 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647346 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647430 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647647 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647732 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.647947 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648031 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648248 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648343 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648594 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648682 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648905 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.648992 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649227 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649320 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649534 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649618 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649835 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.649981 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650135 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650227 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650439 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650524 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650765 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.650848 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651074 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651173 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651414 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651499 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651731 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.651815 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652051 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652142 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652361 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652491 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652698 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.652782 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653005 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653091 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653313 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653404 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653624 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653719 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.653928 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654012 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654237 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654329 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654547 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654685 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654853 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.654989 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655158 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655295 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655468 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655556 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655781 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.655873 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656086 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656173 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656416 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656521 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656718 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.656809 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657032 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657116 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657371 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657463 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657684 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.657768 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658004 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658088 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658312 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658403 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658623 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658713 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.658929 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659013 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659235 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659395 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659541 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659625 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659849 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.659934 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660172 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660273 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660512 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660601 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660823 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.660910 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661132 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661223 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661439 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661530 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661749 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.661840 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662054 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662140 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662358 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662442 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662664 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662755 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.662980 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663072 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663306 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663397 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663623 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663756 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.663923 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664010 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664232 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664318 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664566 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664663 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664876 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.664961 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665182 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665267 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665487 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665579 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665787 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.665871 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666092 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666177 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666402 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666495 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666709 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.666793 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667015 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667099 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667316 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667408 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667617 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667746 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.667922 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668007 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668226 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668312 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668550 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668637 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668860 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.668945 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669171 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669257 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669479 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669563 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669789 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.669874 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670109 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670247 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670410 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670547 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670713 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.670844 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671014 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671145 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671330 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671418 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671633 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671726 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.671932 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672016 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672234 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672318 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672557 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672656 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672901 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.672993 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673207 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673300 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673511 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673604 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673827 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.673918 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674136 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674221 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674442 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674538 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674751 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.674837 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.675058 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.675149 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.675368 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.675453 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.675685 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.676322 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.676537 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.676671 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.676833 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.676975 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677146 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677277 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677456 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677592 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677767 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.677909 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678077 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678215 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678385 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678514 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678693 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.678824 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679004 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679138 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679309 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679448 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679613 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679743 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.679922 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.680088 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.680227 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.680505 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.680812 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.680945 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681141 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681280 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681455 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681593 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681772 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.681903 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682090 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682235 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682407 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682550 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682734 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.682863 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683048 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683184 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683355 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683491 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683656 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683791 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.683963 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684106 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684252 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684413 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684578 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684718 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.684883 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685013 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685185 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685321 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685487 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685615 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685787 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.685881 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686122 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686260 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686396 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686525 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686680 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.686819 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687005 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687145 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687306 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687444 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687610 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687740 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.687909 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688048 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688212 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688342 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688539 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688673 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688826 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.688958 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689136 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689275 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689438 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689567 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689739 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.689868 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690042 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690176 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690371 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690462 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690671 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.690764 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.691006 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.691092 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.691333 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.691523 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.691712 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.692297 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.692532 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.692623 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.692850 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.692934 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693152 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693247 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693456 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693549 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693756 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.693869 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694062 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694240 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694370 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694516 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694654 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694788 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.694933 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695067 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695245 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695376 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695553 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695683 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695853 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.695987 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.696154 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.696346 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.696602 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.696779 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.696970 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.697147 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.697322 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.697497 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.697676 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.697860 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698045 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698249 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698429 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698604 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698779 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.698999 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.699174 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.699358 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.699533 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.699709 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.699887 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.700073 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.700269 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.700468 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.700677 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.700864 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701043 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701239 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701414 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701598 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701773 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.701947 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.702132 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.702310 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.702507 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.702694 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.702880 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.703105 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.703300 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.703485 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.703684 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.703856 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704035 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704215 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704429 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704601 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704771 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.704966 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705152 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705336 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705533 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705715 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705838 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.705938 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706053 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706179 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706352 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706471 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706584 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706707 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706822 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.706947 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707067 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707183 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707297 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707411 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707526 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707651 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707768 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707882 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.707997 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708112 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708225 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708349 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708490 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708605 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708718 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708832 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.708962 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709088 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709204 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709319 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709434 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709548 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709673 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709789 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.709903 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710017 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710132 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710257 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710433 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710563 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710681 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710797 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.710915 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711028 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711153 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711271 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711393 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711509 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711624 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711754 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711869 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.711983 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712096 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712208 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712324 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712548 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712673 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712798 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.712922 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713037 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713153 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713280 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713398 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713512 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713627 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713741 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713855 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.713981 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714098 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714220 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714337 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714451 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714567 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714692 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714808 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.714923 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715086 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715209 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715407 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715530 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715728 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.715850 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716035 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716153 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716346 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716563 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716755 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.716930 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.717114 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.717292 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.717484 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.717677 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.717854 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718032 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718214 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718389 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718575 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718753 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.718927 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.719117 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.719292 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.719570 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.719791 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.719981 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.720156 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.720340 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.720575 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.720777 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.720959 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.721156 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.721359 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.721557 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.721751 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.721971 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.722179 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.722379 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.722594 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.722800 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.723001 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.723216 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.723414 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.723613 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.723812 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.724010 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.724223 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.724444 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.724682 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.724892 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.725094 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.725325 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.725545 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.725749 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.725959 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.726180 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.726389 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.726597 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.726744 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.726883 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727026 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727163 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727298 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727402 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727495 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727576 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727653 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727730 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727813 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.727970 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728059 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728138 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728222 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728301 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728442 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728538 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728618 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728694 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728770 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728853 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.728931 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729016 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729102 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729226 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729313 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729391 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729467 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729552 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729630 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729706 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729782 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729857 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.729940 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730018 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730097 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730180 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730258 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730334 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730465 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730675 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.730886 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731026 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731199 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731337 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731509 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731659 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731834 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.731973 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732158 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732291 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732507 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732652 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732814 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.732946 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733129 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733271 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733439 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733571 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733760 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.733891 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734075 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734220 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734385 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734528 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734687 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734817 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.734993 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735215 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735434 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735630 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735630 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735996 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.735996 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.736332 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.737082 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.737288 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.737484 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.737678 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.737919 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.738226 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.738940 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.739149 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.739345 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.739544 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.739544 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.739959 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.740181 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.740432 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.740597 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.740738 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.740875 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741011 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741157 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741307 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741307 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741567 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741567 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741839 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.741839 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.742687 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.742836 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.742970 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743103 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743195 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743275 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743352 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743428 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743512 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743598 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743675 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743753 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743829 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743905 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.743982 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744066 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744152 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744230 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744307 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744401 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744524 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744628 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744710 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744788 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744865 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.744941 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745017 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745102 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745181 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745258 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745334 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745410 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745498 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745577 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745703 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745909 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.745996 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746215 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746310 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746536 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746640 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746872 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.746987 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747202 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747312 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747513 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747608 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747845 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.747939 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748171 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748273 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748518 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748623 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748845 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.748937 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749149 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749242 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749456 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749610 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749764 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.749880 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750068 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750205 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750370 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750481 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750670 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750794 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.750971 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751084 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751269 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751392 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751568 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751690 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751868 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.751957 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752169 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752256 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752502 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752609 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752805 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.752891 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753123 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753210 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753427 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753521 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753727 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.753819 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.754579 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.754676 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.754897 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.754992 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755244 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755395 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755535 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755629 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755869 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.755964 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756188 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756276 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756537 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756627 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756848 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.756935 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757161 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757246 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757478 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757564 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757793 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.757880 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758108 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758192 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758421 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758506 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758734 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.758820 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759046 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759137 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759358 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759443 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759669 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759756 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.759976 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760060 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760288 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760379 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760626 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760713 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.760944 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.761184 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.761496 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.761593 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.761823 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.761909 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762186 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762283 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762442 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762541 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762750 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.762836 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763065 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763151 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763378 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763476 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763688 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763774 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.763999 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764085 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764309 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764456 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764643 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764741 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.764970 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765056 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765292 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765386 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765621 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765713 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.765938 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766105 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766261 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766348 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766575 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766659 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.766890 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.767236 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.767461 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.767547 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.767803 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.767889 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768112 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768205 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768432 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768521 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768751 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.768839 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769064 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769151 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769378 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769467 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769713 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.769797 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770026 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770119 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770340 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770424 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770651 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770744 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.770961 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771047 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771268 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771353 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771580 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771676 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.771892 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772012 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772289 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772403 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772570 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772668 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772887 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.772974 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.773199 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.773284 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.773513 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.773599 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.773826 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774031 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774346 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774433 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774667 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774761 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.774992 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775077 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775318 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775404 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775632 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775718 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.775949 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776046 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776270 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776364 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776603 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776740 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776910 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.776996 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777215 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777319 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777521 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777606 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777825 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.777919 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778126 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778219 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778442 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778528 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778744 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.778830 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779048 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779142 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779361 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779447 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779670 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.779889 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780197 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780296 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780565 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780668 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780879 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.780972 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781204 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781290 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781523 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781610 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781832 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.781919 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782135 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782230 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782458 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782576 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782759 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.782857 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783063 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783160 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783373 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783476 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783679 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783781 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.783982 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784084 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784282 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784377 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784615 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784733 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.784920 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785014 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785244 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785338 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785627 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785741 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785857 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.785958 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786178 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786264 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786477 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786573 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786779 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.786865 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787080 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787205 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787384 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787482 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787687 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787773 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.787988 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788074 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788290 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788377 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788615 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788712 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.788925 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789010 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789223 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789316 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789528 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789621 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789829 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.789916 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790134 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790220 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790435 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790522 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790739 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.790825 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791040 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791126 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791353 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791438 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791654 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791747 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.791956 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792049 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792268 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792352 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792615 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792715 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.792928 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793014 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793235 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793320 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793544 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793641 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793884 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.793975 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.794197 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.794418 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.794727 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.794820 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795108 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795195 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795430 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795524 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795770 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.795860 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796081 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796174 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796411 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796503 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796730 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.796894 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797059 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797206 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797374 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797532 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797689 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.797844 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798001 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798155 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798313 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798465 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798626 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798775 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.798938 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799085 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799250 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799402 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799561 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799714 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.799875 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.800023 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.800218 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.800333 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.800566 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.800700 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.801404 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.801543 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.801724 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.801861 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802043 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802178 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802357 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802493 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802671 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802814 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.802983 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803122 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803293 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803432 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803610 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803741 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.803942 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.804054 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.804257 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.804412 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.804590 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.804718 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805014 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805100 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805329 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805423 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805652 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805747 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.805977 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806064 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806297 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806391 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806623 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806755 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.806948 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807078 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807262 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807358 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807584 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807672 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807896 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.807981 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808206 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808299 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808556 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808647 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808894 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.808980 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809218 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809305 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809524 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809611 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809829 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.809915 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810129 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810215 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810430 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810515 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810739 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.810836 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811059 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811144 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811372 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811457 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811681 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811774 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.811990 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812075 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812302 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812411 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812634 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812731 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.812957 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813055 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813272 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813364 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813585 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813679 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813892 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.813978 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814212 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814305 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814521 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814609 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814832 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.814924 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815140 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815225 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815449 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815544 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815758 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.815851 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.816063 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.816149 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.816423 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.816548 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.817301 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.817399 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.817609 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.817698 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.817935 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818029 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818252 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818339 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818572 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818666 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818885 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.818971 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819194 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819281 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819520 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819617 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819829 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.819915 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820140 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820226 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820473 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820576 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820788 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.820881 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821102 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821186 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821415 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821501 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821740 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.821827 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822064 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822149 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822389 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822482 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822715 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.822808 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823033 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823122 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823360 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823447 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823695 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823781 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.823939 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 15:08:54.824034 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:08:54.824261 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 15:08:54.846791 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:54.847990 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_db.sqlalchemy.engines [None req-e5223107-143f-40b9-8e80-4acb224545db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.023669 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.context [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),860507c8-0e7d-40f5-a3f0-4d31c653347c(cell1) {{(pid=101457) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 15:08:55.025492 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.context [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),860507c8-0e7d-40f5-a3f0-4d31c653347c(cell1) {{(pid=101458) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 15:08:55.028208 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_concurrency.lockutils [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:08:55.029813 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_concurrency.lockutils [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:08:55.030241 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:08:55.030626 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_concurrency.lockutils [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:08:55.031799 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:08:55.032601 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_concurrency.lockutils [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:08:55.032701 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:08:55.034529 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:08:55.043639 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_db.sqlalchemy.engines [None req-e5223107-143f-40b9-8e80-4acb224545db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.045739 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_db.sqlalchemy.engines [None req-e5223107-143f-40b9-8e80-4acb224545db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.048044 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.050352 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.311707 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG oslo_db.sqlalchemy.engines [None req-e5223107-143f-40b9-8e80-4acb224545db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.314700 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:08:55.734382 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: WARNING keystonemiddleware.auth_token [None req-e5223107-143f-40b9-8e80-4acb224545db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:08:55.740890 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: WARNING keystonemiddleware.auth_token [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:08:55.750660 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: WARNING keystonemiddleware.auth_token [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:08:55.757787 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: WARNING keystonemiddleware.auth_token [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:08:56.094128 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: WARNING keystonemiddleware.auth_token [None req-e5223107-143f-40b9-8e80-4acb224545db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:08:56.099376 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: WARNING keystonemiddleware.auth_token [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:08:56.106020 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c190cef9c0 pid: 101457 (default app) Oct 28 15:08:56.108119 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:08:56.109326 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: WARNING keystonemiddleware.auth_token [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:08:56.109428 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-e5223107-143f-40b9-8e80-4acb224545db None None] 10.222.0.86 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Oct 28 15:08:56.109735 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 788 bytes} [Thu Oct 28 15:08:56 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:08:56.114658 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: WARNING keystonemiddleware.auth_token [None req-8b8dd50d-f053-4ac2-a6f6-3fd7bfcaeaa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:08:56.120990 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c190cef9c0 pid: 101458 (default app) Oct 28 15:10:20.643844 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:20.644866 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-e5223107-143f-40b9-8e80-4acb224545db None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 28 15:10:20.645253 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 2/2] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:21.134242 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-5a3e53f7-adb4-4123-95af-c52891ac5704 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:21.134242 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-5a3e53f7-adb4-4123-95af-c52891ac5704 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479484 Oct 28 15:10:21.134242 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Oct 28 15:10:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:23.436727 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-e5223107-143f-40b9-8e80-4acb224545db None None] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:23.437703 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-e5223107-143f-40b9-8e80-4acb224545db None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 Oct 28 15:10:23.438098 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 3/4] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:23.496477 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-26c6b4b9-1c14-4178-80c1-5a97a7c4c6c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:23.514316 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:10:23.514316 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:10:23.611650 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-26c6b4b9-1c14-4178-80c1-5a97a7c4c6c4 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.166728 Oct 28 15:10:23.612484 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 2/5] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:10:23.830335 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-c708aa6e-2e1f-4b39-aa7f-70fdd57bd72f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:23.832778 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:10:23.832778 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: warnings.warn(msg) Oct 28 15:10:23.991258 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-c708aa6e-2e1f-4b39-aa7f-70fdd57bd72f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370249 Oct 28 15:10:23.991943 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 4/6] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Oct 28 15:10:23 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:26.376347 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-26c6b4b9-1c14-4178-80c1-5a97a7c4c6c4 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:26.377396 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-26c6b4b9-1c14-4178-80c1-5a97a7c4c6c4 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 28 15:10:26.377793 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 3/7] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:26.491844 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-19ad185e-1b12-4334-a66b-528c1dda4bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:26.510903 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:10:26.510903 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: warnings.warn(msg) Oct 28 15:10:26.620168 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-19ad185e-1b12-4334-a66b-528c1dda4bf4 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.233638 Oct 28 15:10:26.621187 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 5/8] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:10:26.634068 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-54b5a3c9-d2a8-4535-9e3e-d7707cbec4d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:26.679817 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:10:26.679817 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:10:27.182322 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-54b5a3c9-d2a8-4535-9e3e-d7707cbec4d9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.551979 Oct 28 15:10:27.182911 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 4/9] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Oct 28 15:10:26 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:10:29.496986 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-19ad185e-1b12-4334-a66b-528c1dda4bf4 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:29.499006 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-19ad185e-1b12-4334-a66b-528c1dda4bf4 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002603 Oct 28 15:10:29.500131 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 6/10] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:29 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:29.570268 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-f7102e28-57ad-4bfd-9cf3-aed3e8bfbbb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:29.678737 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-f7102e28-57ad-4bfd-9cf3-aed3e8bfbbb7 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.171584 Oct 28 15:10:29.678983 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 5/11] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:10:29.692839 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-386ae2bc-89d2-4d74-a2d9-33e39f6b0c7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:29.774599 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-386ae2bc-89d2-4d74-a2d9-33e39f6b0c7a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085476 Oct 28 15:10:29.775213 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 7/12] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Oct 28 15:10:29 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:32.101858 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-f7102e28-57ad-4bfd-9cf3-aed3e8bfbbb7 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:32.102850 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-f7102e28-57ad-4bfd-9cf3-aed3e8bfbbb7 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 28 15:10:32.103402 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 6/13] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:32.189630 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-8dcb4f81-c021-4735-baf5-aa2c52f43131 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:32.304546 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-8dcb4f81-c021-4735-baf5-aa2c52f43131 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.193894 Oct 28 15:10:32.305005 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 8/14] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:10:32.319370 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-6d253568-0d2e-4396-9740-b8e9fdc5e859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:32.416457 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-6d253568-0d2e-4396-9740-b8e9fdc5e859 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101909 Oct 28 15:10:32.417068 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 7/15] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Oct 28 15:10:32 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:34.758863 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-8dcb4f81-c021-4735-baf5-aa2c52f43131 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:34.759859 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-8dcb4f81-c021-4735-baf5-aa2c52f43131 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 28 15:10:34.760534 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 9/16] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:34.826206 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 20, "name": "ds4G", "vcpus": 4}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:34.888278 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119659 Oct 28 15:10:34.889002 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 8/17] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:10:34.901936 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-172bea70-2aaa-4d6f-bc66-160a0ec92bcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:34.999595 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-172bea70-2aaa-4d6f-bc66-160a0ec92bcb admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101588 Oct 28 15:10:35.000584 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 10/18] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Oct 28 15:10:34 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:37.412831 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:37.413906 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 28 15:10:37.414291 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 9/19] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:37.474875 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-15cd6487-e55e-4c25-ba79-0d3bf2e66744 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:37.503032 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-15cd6487-e55e-4c25-ba79-0d3bf2e66744 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081258 Oct 28 15:10:37.503711 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Oct 28 15:10:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:10:39.917467 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:39.918577 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-45c2dc2f-7292-41d7-80a9-0683e2aa1b55 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 15:10:39.918960 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 10/21] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:39.982541 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-c5924ba8-d228-413f-beae-8271880e4591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:40.065043 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-c5924ba8-d228-413f-beae-8271880e4591 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.139346 Oct 28 15:10:40.065593 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 12/22] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:39 2021] POST /compute/v2.1/flavors => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:10:40.079767 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-61f92730-6ae7-4e63-963d-f02ff55bfbd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:40.205168 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-61f92730-6ae7-4e63-963d-f02ff55bfbd9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130553 Oct 28 15:10:40.205722 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 11/23] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Oct 28 15:10:40 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:42.529429 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-c5924ba8-d228-413f-beae-8271880e4591 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:42.530434 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-c5924ba8-d228-413f-beae-8271880e4591 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 28 15:10:42.530833 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:42.589638 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-073f0e84-4c7f-4bd3-afbe-9f212e0990b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:42.663566 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-073f0e84-4c7f-4bd3-afbe-9f212e0990b9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126329 Oct 28 15:10:42.664114 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 12/25] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:10:42.677243 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-2a917391-32f7-414e-8890-6bc74a092aa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:42.753289 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-2a917391-32f7-414e-8890-6bc74a092aa7 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079690 Oct 28 15:10:42.753862 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 14/26] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Oct 28 15:10:42 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:10:45.041230 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-073f0e84-4c7f-4bd3-afbe-9f212e0990b9 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:45.042289 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-073f0e84-4c7f-4bd3-afbe-9f212e0990b9 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 28 15:10:45.042686 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:45.101449 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-6cce280e-257d-467a-8b0a-0a1b27f1f5dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:45.177830 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-6cce280e-257d-467a-8b0a-0a1b27f1f5dd admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128196 Oct 28 15:10:45.178465 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 15/28] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:45 2021] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:10:45.190687 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-c7339fa6-5fd8-4d45-a22d-feef82c69704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:45.318757 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-c7339fa6-5fd8-4d45-a22d-feef82c69704 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131535 Oct 28 15:10:45.319336 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 14/29] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Oct 28 15:10:45 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:10:47.700224 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-6cce280e-257d-467a-8b0a-0a1b27f1f5dd admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:47.702006 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-6cce280e-257d-467a-8b0a-0a1b27f1f5dd admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002861 Oct 28 15:10:47.702512 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 16/30] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:47 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:47.769190 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-55689559-629b-411a-a3eb-218be1da7e68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:47.858248 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-55689559-629b-411a-a3eb-218be1da7e68 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148680 Oct 28 15:10:47.858826 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 15/31] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:10:47.872104 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-d276bf7e-3e1a-4af6-a068-1facb2c85b9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:47.947010 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-d276bf7e-3e1a-4af6-a068-1facb2c85b9b admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078996 Oct 28 15:10:47.948238 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 17/32] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Oct 28 15:10:47 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:10:50.288021 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-55689559-629b-411a-a3eb-218be1da7e68 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:10:50.289238 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-55689559-629b-411a-a3eb-218be1da7e68 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Oct 28 15:10:50.289841 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 16/33] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:10:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:10:50.358910 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:50.434750 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138005 Oct 28 15:10:50.435631 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 18/34] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Oct 28 15:10:50 2021] POST /compute/v2.1/flavors => generated 408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:10:50.449484 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-cdd85aac-09b3-4eba-9194-a2f812ce7f4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:10:50.544889 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-cdd85aac-09b3-4eba-9194-a2f812ce7f4d admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099713 Oct 28 15:10:50.545670 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 17/35] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Oct 28 15:10:50 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:11:29.451976 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:29.453008 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 28 15:11:29.453404 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 19/36] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:11:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:29.509666 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-a59d94c3-c619-4ac9-9301-5999efdf27b5 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:29.526633 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-a59d94c3-c619-4ac9-9301-5999efdf27b5 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066637 Oct 28 15:11:29.527155 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 18/37] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Oct 28 15:11:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:11:31.052508 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:31.053496 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-1e798cc3-38f5-45f1-ae21-c282048071db admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 15:11:31.053884 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 20/38] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:31.244783 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-38256d5e-1c95-4dba-812b-272e7ea819b8 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:31.250169 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.wsgi [None req-38256d5e-1c95-4dba-812b-272e7ea819b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 15:11:31.250719 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-38256d5e-1c95-4dba-812b-272e7ea819b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:31.251501 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-38256d5e-1c95-4dba-812b-272e7ea819b8 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059079 Oct 28 15:11:31.252014 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 19/39] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Oct 28 15:11:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 15:11:31.263026 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-2abedc16-5297-44d2-9189-87e6657cec50 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:31.283120 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-2abedc16-5297-44d2-9189-87e6657cec50 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024444 Oct 28 15:11:31.283654 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 21/40] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:11:31.293824 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-32a9b4dc-5140-4efb-882b-9d20d25994c5 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:31.314401 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-32a9b4dc-5140-4efb-882b-9d20d25994c5 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024003 Oct 28 15:11:31.314920 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 20/41] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:11:31.325251 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-61adda39-8ef0-4120-abc6-07221518cbcf admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:31.330524 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.wsgi [None req-61adda39-8ef0-4120-abc6-07221518cbcf admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 15:11:31.331083 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-61adda39-8ef0-4120-abc6-07221518cbcf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:31.331865 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-61adda39-8ef0-4120-abc6-07221518cbcf admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010702 Oct 28 15:11:31.332350 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 22/42] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Oct 28 15:11:31 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 15:11:32.747237 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-32a9b4dc-5140-4efb-882b-9d20d25994c5 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:32.748267 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-32a9b4dc-5140-4efb-882b-9d20d25994c5 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 28 15:11:32.748682 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:32.940235 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-2fb7b947-9555-480f-a174-ca4962d7a629 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:32.946287 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.wsgi [None req-2fb7b947-9555-480f-a174-ca4962d7a629 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 15:11:32.946860 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-2fb7b947-9555-480f-a174-ca4962d7a629 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:32.947637 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-2fb7b947-9555-480f-a174-ca4962d7a629 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059162 Oct 28 15:11:32.948139 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 23/44] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Oct 28 15:11:32 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 15:11:32.958135 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-ec8ce919-276b-4388-8f21-8b3e75b5f7f1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:32.972690 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-ec8ce919-276b-4388-8f21-8b3e75b5f7f1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018132 Oct 28 15:11:32.973209 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 22/45] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:11:32.983065 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-13e0759a-1f8b-4a06-8c1d-4001276b3b8b admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:32.996102 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-13e0759a-1f8b-4a06-8c1d-4001276b3b8b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016463 Oct 28 15:11:32.996636 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 24/46] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:11:33.005983 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-fef05344-f72b-4c1e-8bb0-018c7bf8a953 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:33.011497 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.wsgi [None req-fef05344-f72b-4c1e-8bb0-018c7bf8a953 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 15:11:33.012032 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-fef05344-f72b-4c1e-8bb0-018c7bf8a953 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:33.012836 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-fef05344-f72b-4c1e-8bb0-018c7bf8a953 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010273 Oct 28 15:11:33.013587 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 23/47] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Oct 28 15:11:33 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 15:11:34.462866 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-13e0759a-1f8b-4a06-8c1d-4001276b3b8b admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:34.463856 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-13e0759a-1f8b-4a06-8c1d-4001276b3b8b admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Oct 28 15:11:34.464243 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 25/48] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:34.652556 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-4cddd0a1-ecf4-488b-b64f-82d8fc73f7aa admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:34.658094 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.wsgi [None req-4cddd0a1-ecf4-488b-b64f-82d8fc73f7aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 15:11:34.658640 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-4cddd0a1-ecf4-488b-b64f-82d8fc73f7aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:34.659403 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-4cddd0a1-ecf4-488b-b64f-82d8fc73f7aa admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057547 Oct 28 15:11:34.659894 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 24/49] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:11:34 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 15:11:34.669992 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-a32e443b-1688-4fe3-862e-e3bf0fd62a7b admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:34.683575 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-a32e443b-1688-4fe3-862e-e3bf0fd62a7b admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016997 Oct 28 15:11:34.684041 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 26/50] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:11:34.693477 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:34.706286 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016134 Oct 28 15:11:34.706786 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 25/51] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Oct 28 15:11:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:11:34.715988 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-73dfa14e-78f0-43a5-87f0-dcec7c7a817d admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:34.720950 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.wsgi [None req-73dfa14e-78f0-43a5-87f0-dcec7c7a817d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 15:11:34.721495 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-73dfa14e-78f0-43a5-87f0-dcec7c7a817d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:11:34.722253 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-73dfa14e-78f0-43a5-87f0-dcec7c7a817d admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009650 Oct 28 15:11:34.722743 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 27/52] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:11:34 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 15:11:36.160864 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:36.161854 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 15:11:36.162242 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 26/53] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:36.351995 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-5b36292d-2b4a-43c3-9a58-86d3e8130601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:11:36.437369 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-5b36292d-2b4a-43c3-9a58-86d3e8130601 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136353 Oct 28 15:11:36.437902 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 28/54] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Oct 28 15:11:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:11:37.877399 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:37.878431 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 15:11:37.878814 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 27/55] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:38.070075 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-579463d6-cb5f-48a8-a8d8-6e72a3ff6d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:11:38.157575 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-579463d6-cb5f-48a8-a8d8-6e72a3ff6d8d admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.138959 Oct 28 15:11:38.158126 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 29/56] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Oct 28 15:11:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:11:39.583695 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:39.584732 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Oct 28 15:11:39.585129 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 28/57] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:39.778347 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-2626a70c-f788-450f-8dae-32af15d51a9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:11:39.872176 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-2626a70c-f788-450f-8dae-32af15d51a9f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.145511 Oct 28 15:11:39.872696 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 30/58] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Oct 28 15:11:39 2021] POST /compute/v2.1/flavors => generated 407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:11:41.289707 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:41.290690 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Oct 28 15:11:41.291077 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 29/59] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:41.482035 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-7cadcd70-c095-4739-a45a-9497492de569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:11:41.568556 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-7cadcd70-c095-4739-a45a-9497492de569 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.137469 Oct 28 15:11:41.569027 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 31/60] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Oct 28 15:11:41 2021] POST /compute/v2.1/flavors => generated 409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:11:42.982418 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:42.983415 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 28 15:11:42.983806 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 30/61] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:11:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:11:43.177627 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-e5308b0a-9d78-4af2-a1f5-693120e52bc4 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:11:43.197014 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-e5308b0a-9d78-4af2-a1f5-693120e52bc4 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069635 Oct 28 15:11:43.197746 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 32/62] 10.222.0.86 () {60 vars in 1202 bytes} [Thu Oct 28 15:11:43 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:12:30.188174 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.189205 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-9fa33b5a-7fcb-4aae-9407-a2ef953ca3d1 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 28 15:12:30.189599 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 31/63] 10.222.0.86 () {54 vars in 930 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:12:30.246702 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-977309fc-2cf2-447c-a7d4-b9b3f6a5eba5 admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.265895 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-977309fc-2cf2-447c-a7d4-b9b3f6a5eba5 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069256 Oct 28 15:12:30.266415 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 33/64] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:12:30.288251 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-8309a42c-bc8f-465d-b3bb-600928ccd414 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.295878 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-8309a42c-bc8f-465d-b3bb-600928ccd414 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011065 Oct 28 15:12:30.296415 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 32/65] 10.222.0.86 () {60 vars in 1282 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:12:30.308216 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-d79b3fa4-7e95-4058-935e-56355549e74a admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.315402 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-d79b3fa4-7e95-4058-935e-56355549e74a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010469 Oct 28 15:12:30.315900 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 34/66] 10.222.0.86 () {60 vars in 1285 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:12:30.327496 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-a0b10320-be63-432e-b5ec-884112a49f50 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.334631 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-a0b10320-be63-432e-b5ec-884112a49f50 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010379 Oct 28 15:12:30.335135 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1285 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:12:30.346129 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:12:30.353206 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010319 Oct 28 15:12:30.353707 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 35/68] 10.222.0.86 () {60 vars in 1282 bytes} [Thu Oct 28 15:12:30 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:14:01.020688 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-252ff456-2982-47fd-96dc-fafa73a0b84e tempest-verify_tempest_config-2043553729 tempest-verify_tempest_config-2043553729-project] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:14:01.022670 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-252ff456-2982-47fd-96dc-fafa73a0b84e tempest-verify_tempest_config-2043553729 tempest-verify_tempest_config-2043553729-project] 10.222.0.86 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113480 Oct 28 15:14:01.023197 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 34/69] 10.222.0.86 () {58 vars in 1133 bytes} [Thu Oct 28 15:14:00 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:15:34.556447 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:34.557508 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 28 15:15:34.557894 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 36/70] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:15:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:15:34.809902 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:34.811032 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:15:34.811032 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:15:34.812598 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:34.813027 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:34.813799 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:34.814219 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:34.847642 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-4465deeb-7e58-4f33-8170-eb723a93eb33 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149019 Oct 28 15:15:34.853082 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 35/71] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:15:34 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:15:36.292653 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:36.293674 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 28 15:15:36.294040 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 37/72] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:15:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:15:36.488838 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:36.489969 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:15:36.489969 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:15:36.491511 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:36.491937 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:36.492755 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:36.493169 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:36.512348 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-4ecd7af3-553f-4f48-95d4-1a0c63c74812 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074760 Oct 28 15:15:36.512847 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 36/73] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:15:36 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:15:48.345591 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:48.347212 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Oct 28 15:15:48.347549 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 38/74] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:15:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:15:48.535943 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:48.537107 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:15:48.537107 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:15:48.538613 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:48.539045 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:48.539829 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:48.540248 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:48.564370 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-0e941ac5-cd9d-44f7-99d5-5b1b676e67e6 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079525 Oct 28 15:15:48.564932 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 37/75] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:15:48 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:15:49.980173 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: DEBUG nova.api.openstack.wsgi [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] Calling method '>' {{(pid=101457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:49.981237 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: INFO nova.api.openstack.requestlog [None req-9a56f58f-053c-4c77-9743-fa19a56c14ed admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 28 15:15:49.981623 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: [pid: 101457|app: 0|req: 39/76] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Oct 28 15:15:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:15:50.170708 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG nova.api.openstack.wsgi [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] Calling method '>' {{(pid=101458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:15:50.171829 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:15:50.171829 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: warnings.warn(msg) Oct 28 15:15:50.173353 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:50.173780 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:50.174581 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:15:50.174992 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: DEBUG oslo_concurrency.lockutils [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:15:50.195697 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: INFO nova.api.openstack.requestlog [None req-782d4d70-cdfa-46d2-8352-34c68a3f6d07 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075859 Oct 28 15:15:50.196222 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: [pid: 101458|app: 0|req: 38/77] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Oct 28 15:15:50 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:16:47.791411 dv-cinder-783643-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 15:16:47.792051 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: Thu Oct 28 15:16:47 2021 - graceful shutdown triggered... Oct 28 15:16:47.792570 dv-cinder-783643-3-iscsi devstack@n-api.service[101457]: Gracefully killing worker 1 (pid: 101457)... Oct 28 15:16:47.792950 dv-cinder-783643-3-iscsi devstack@n-api.service[101458]: Gracefully killing worker 2 (pid: 101458)... Oct 28 15:16:48.792515 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: worker 1 buried after 1 seconds Oct 28 15:16:48.792928 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: worker 2 buried after 1 seconds Oct 28 15:16:48.792928 dv-cinder-783643-3-iscsi devstack@n-api.service[101456]: goodbye to uWSGI. Oct 28 15:16:48.794090 dv-cinder-783643-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 15:16:48.794643 dv-cinder-783643-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 15:16:48.797802 dv-cinder-783643-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 15:16:48.807764 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 15:16:48 2021] *** Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: nodename: dv-cinder-783643-3-iscsi Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: machine: x86_64 Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: clock source: unix Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: pcre jit disabled Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: detected number of CPU cores: 4 Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: current working directory: / Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: detected binary path: /usr/bin/uwsgi-core Oct 28 15:16:48.809813 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: your processes number limit is 47680 Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: your memory page size is 4096 bytes Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: detected max file descriptor number: 2048 Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: lock engine: pthread robust mutexes Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: thunder lock: enabled Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 15:16:48.810607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 15:16:48.856146 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: Python main interpreter initialized at 0x55d4552fd9c0 Oct 28 15:16:48.856146 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: python threads support enabled Oct 28 15:16:48.856146 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: your server socket listen backlog is limited to 100 connections Oct 28 15:16:48.856146 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: your mercy for graceful operations on workers is 90 seconds Oct 28 15:16:48.856607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 15:16:48.856607 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: *** Operational MODE: preforking *** Oct 28 15:16:48.856891 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: *** uWSGI is running in multiple interpreter mode *** Oct 28 15:16:48.856891 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: spawned uWSGI master process (pid: 116410) Oct 28 15:16:48.857092 dv-cinder-783643-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 15:16:48.857376 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: spawned uWSGI worker 1 (pid: 116431, cores: 1) Oct 28 15:16:48.858189 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: spawned uWSGI worker 2 (pid: 116432, cores: 1) Oct 28 15:16:48.858189 dv-cinder-783643-3-iscsi devstack@n-api.service[116410]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 15:16:50.676445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:16:50.676445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: from cryptography.utils import int_from_bytes Oct 28 15:16:50.677763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:16:50.677763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: from cryptography.utils import int_from_bytes Oct 28 15:16:50.723555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:16:50.723555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: from cryptography.utils import int_from_bytes Oct 28 15:16:50.724217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 15:16:50.724217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: from cryptography.utils import int_from_bytes Oct 28 15:16:53.235458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 15:16:53.236422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 15:16:53.237440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 15:16:53.237841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 15:16:53.238099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 15:16:53.238493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.238824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.239148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.239472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.239805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.240118 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.240547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.240874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.241204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.241465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.241786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.242112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-783643-3-iscsi {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.242433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.242743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.243055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.243372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.243683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.244007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.244315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.244845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.245300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.245609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.245921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.246264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.246574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.246897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.247205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.247512 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.247842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.248168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.248610 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-783643-3-iscsi {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.248929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.249248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.249559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.249977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.250294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.250604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.250930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.251268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.251583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.251889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.252207 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.253131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.253718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.254019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.254331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.254648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.254985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.255291 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.255597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.255996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.256173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.256498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.257016 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.257339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.257591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.257841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.258159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.258479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.258789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.259100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.259407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.259716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.260022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.260525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.260841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.261152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.261473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.261791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.262114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.262424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.262746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.263146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.263400 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.263714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.264059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.264375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.264700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 15:16:53.265195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.265343 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 15:16:53.265493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.265493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.265785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 15:16:53.265942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.266085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 15:16:53.266239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.266390 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 15:16:53.266541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.266685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.266837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.266991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.267921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.268982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.269891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-783643-3-iscsi {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.270855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.271902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.272953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.273259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.273550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.273705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.273848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.274877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.275987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.276928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-783643-3-iscsi {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.277975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.278894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.279856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.280957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281115 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.281943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.282395 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.282731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.282937 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.283268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.283612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.283938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.284288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.284490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.284659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.284805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.284947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.285089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.285241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.285391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.285544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.285695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.285844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.285994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.286186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.286331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.286483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.286635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.286786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.286936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.287086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.287239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.287395 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.287546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.287705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.287856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.288000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.288152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.288304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.288524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.288676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.288837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.289001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.289152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.289300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.289444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.289585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.289735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.289892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.290042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.290190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.290333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.290475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.290624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.290781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.290934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.291076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.291225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.291374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.291524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.291679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.291823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.291965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.292113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.292264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.292443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.292608 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.292911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.293075 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.293330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.293487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.293663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.293887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.294037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.294187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.294357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.294576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.294737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.294889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.295041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.295195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.295337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.295486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.295637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.295786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.295929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.296079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.296229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.296378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.296561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.296713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.296863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.297014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.297172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.297332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.297332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.297609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.297757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.297907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.298056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.298211 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.298355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.298504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.298653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.298813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.298964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.299125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.299825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.300035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.300182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.300324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.300512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.300671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.300816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.300957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.301099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.301249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.301402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.301556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.301716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.301859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.302012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.302161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.302315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.302468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.302618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.302768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.303078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.303229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.303488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.303647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.303806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.304058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.304210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.304353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.304596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.304824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.304974 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.305122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.305265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.305408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.305564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.305715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.305857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.306016 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.306172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.306326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.306469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.306619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.306762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.306903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.307064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.307215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.307357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.307499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.307650 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.307807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.307961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.308110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.308253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.308436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.308588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.308751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.308899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.309049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.309200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.309351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.309493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.309654 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.309812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.309972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.310117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.310258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.310411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.310560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.310712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.310855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.311004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.311004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.311288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.311431 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.311573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.311714 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.311875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.312026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.312186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.312338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.312544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.312688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.312831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.313008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.313297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.313469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.313700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.313851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 15:16:53.314026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.314260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.314421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.314565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.314707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.315484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.315648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.315803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.315957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.316289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.316464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.316614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.316757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.316925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.317857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318014 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.318854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.319905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.320999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.321894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322629 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.322931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.323087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.323389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.323549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.323712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.323952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.324102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.324274 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.324540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.324691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.324841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.325846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.326861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327461 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.327905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.328049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.328198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.328341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.328508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.329918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.330993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.331889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.332852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333795 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.333971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.334211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.334375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.334552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.334789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.334945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.335984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.336975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.337917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.338869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.339962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.340931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.341869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.342949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.343112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.343263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.343425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.343743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.343743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.344062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.344241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.344509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.344676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.344921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345503 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.345968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.346950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.347882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.348909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349390 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.349997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350771 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.350929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.351858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.352855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.353012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.353213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.353380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.353539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.353866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.354026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.354187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.354346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.354524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.354780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.355043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.355200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.355350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.355719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.355882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.356883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.357982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.358990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.359939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360476 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.360960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.362249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.362423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.362602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.362764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.362924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.363083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.363236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.363386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.363549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.363708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.364940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.365190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.365358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.365509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.365776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.366935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.367950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.368947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.369889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.370047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.370204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.370362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.370527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.370918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.371861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.372847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.373869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.374900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.375183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.375408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.375570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.375751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.375991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.376223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.376379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.376568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.376734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.376895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.377046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.377194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.377397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.378070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.378234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.378636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.378636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.378947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.379872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.380023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.380172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.380335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.380592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.381896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.382727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.383947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.384105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.384276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.384542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.384700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.384857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.385007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.385177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.385437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.385675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.385842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.386997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.387919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.388237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.388470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.388640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.388802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.388960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.389119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.389277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.389436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.389883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.390994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.391984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.392807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.393966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.394128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.394286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.394444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.394708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.394865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.395995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.396144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.396516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.396691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.396851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.397940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.398882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.399970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400291 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.400782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.401097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.401255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.401412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.401673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.401836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.402926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.403886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.404977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.405136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.405298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.405447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.405623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.405893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.406183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.406343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.406603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.406827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.406991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.407931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.408970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409610 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.409939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410405 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.410862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.411952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.412101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.412257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.412532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.412703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.412854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.413925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.414884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.415916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.416249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.416426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.416631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.416880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.417910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.418850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.419936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420759 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.420919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.421989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.422995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.423926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.424086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.424790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.424955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.425152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.425393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.425559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.425710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.425862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.426019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.426386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.426562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.426721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.426890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.427999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.428149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.428371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.428576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.428738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.428898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.429049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.429049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.429356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.429516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.429934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.430896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.431930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.432962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.433975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.434283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.434283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.434587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.434746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.434898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.435946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.436104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.436290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.436728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.436896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.437048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.437289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.437526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.437684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.437845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.438947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.439104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.439254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.439421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.439586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.439859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.440526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.440681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.440843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.441967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.442952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.443887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.444997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.445156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.445314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.445464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.445716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.445959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.446123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.446273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.446432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.446599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.446995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.447158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.447334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.447580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.447814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.447979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448608 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.448929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449395 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.449876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.450952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.451977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.452940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.453928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454839 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.454988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.455972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.456207 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.456378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.456378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.456739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.457060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.457218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.457367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.457545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.457770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.458975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.459897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.460933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.461971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.462988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.463914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.464904 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.465834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.466886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.467244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.467402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.467561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.467712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.467950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.468186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.468358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.468537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.468690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.468848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.469967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.470719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.470880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.470880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.471210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.471372 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.471531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.471701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.471868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.472267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.472464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.472637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.472797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.472956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.473167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.473329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.473535 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.473690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.473842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.474944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.475882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.476041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.476202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.476364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.476714 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.476865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.477016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.477391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.477571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.477725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.477876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.478131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.478383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.478566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.478752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.478914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.479861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.480974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.481998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.482992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.483295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.483710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.483866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.483866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.484981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.485140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.485309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.485461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.485689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.485862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.486014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.486164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.486354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.486514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.487407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.487682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.487839 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.488000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.488261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.488549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.488721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.488875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.489988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.490805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.490975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491589 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.491910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.492865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.493972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.494920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495077 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.495857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496326 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.496854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.497005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.497167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.497344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.497676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.497917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.498082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.498261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.498503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.498746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.498908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.499871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.500933 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.501934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.502208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.503588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.504679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.505696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.506705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.507200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.508624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.508624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.508624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.508624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.508624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.509143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.509229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.509229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.509371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.509877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.510068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.510407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.510726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.511057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.511383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.511715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.512044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.512374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.512726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.513082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.513398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.513748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.514080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 15:16:53.514326 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 15:16:53.535980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_db.sqlalchemy.engines [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.588084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.context [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),860507c8-0e7d-40f5-a3f0-4d31c653347c(cell1) {{(pid=116432) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 15:16:53.592439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:16:53.594010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:16:53.594814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:16:53.597256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:16:53.607889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.609201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.615154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.context [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),860507c8-0e7d-40f5-a3f0-4d31c653347c(cell1) {{(pid=116431) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 15:16:53.619563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:16:53.621199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:16:53.622002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:16:53.623901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:16:53.634746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_db.sqlalchemy.engines [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.635564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_db.sqlalchemy.engines [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.877529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:53.894189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_db.sqlalchemy.engines [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 15:16:54.199737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: WARNING keystonemiddleware.auth_token [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:16:54.207346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: WARNING keystonemiddleware.auth_token [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:16:54.209907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: WARNING keystonemiddleware.auth_token [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:16:54.216531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: WARNING keystonemiddleware.auth_token [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:16:54.560923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: WARNING keystonemiddleware.auth_token [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:16:54.563837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: WARNING keystonemiddleware.auth_token [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 15:16:54.567422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: WARNING keystonemiddleware.auth_token [None req-c2e904fc-a21e-4efe-a26e-1fc17309b922 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:16:54.569706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: WARNING keystonemiddleware.auth_token [None req-d4ae9405-5436-420a-b827-bf9f3f1cf9e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 15:16:54.572572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4552fd9c0 pid: 116431 (default app) Oct 28 15:16:54.574802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4552fd9c0 pid: 116432 (default app) Oct 28 15:17:28.390595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3264d077-0a42-4bb5-9678-6d07da272ffb tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Action: 'create', calling method: .version_select at 0x7fdc18e38f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-174669496", "metadata": {"Type": "work"}}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:30.071741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b7052815-4520-45e2-9b86-77277150abf6 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Action: 'create', calling method: .version_select at 0x7fdc18dbbf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1433680178"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:31.853165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b7052815-4520-45e2-9b86-77277150abf6 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.137640 Oct 28 15:17:31.854018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1/1] 10.222.0.86 () {60 vars in 1154 bytes} [Thu Oct 28 15:17:28 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3140 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 15:17:31.929872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3264d077-0a42-4bb5-9678-6d07da272ffb tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.893190 Oct 28 15:17:31.932141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1/2] 10.222.0.86 () {60 vars in 1155 bytes} [Thu Oct 28 15:17:27 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4897 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 15:17:31.941138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cb8d4e25-cb1a-45be-a81a-a8465ea82f26 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18c95af0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:32.086561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-789718859", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "bd44df2e-02de-459a-af0c-6bb6e018b864"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:32.140863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cb8d4e25-cb1a-45be-a81a-a8465ea82f26 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 200 len: 345 microversion: 2.1 time: 0.206861 Oct 28 15:17:32.141682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:31 2021] GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 345 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:32.146429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ea6e40b6-52a3-423c-bf8f-b0dcc534f9b8 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18c95e50>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:32.159971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] validate_networks() for [('bd44df2e-02de-459a-af0c-6bb6e018b864', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:17:32.247105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ea6e40b6-52a3-423c-bf8f-b0dcc534f9b8 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.104393 Oct 28 15:17:32.248179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 3/4] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:32 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:32.875323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fc9a4e7f-95f6-48fb-8ac2-69ff38f011e3 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc18ca84c0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:32.950180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fc9a4e7f-95f6-48fb-8ac2-69ff38f011e3 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/7e4a63c6-4155-4bb9-bebb-6531598a8880" status: 200 len: 350 microversion: 2.1 time: 0.078057 Oct 28 15:17:32.952897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 4/5] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:32 2021] GET /compute/v2.1/os-volumes/7e4a63c6-4155-4bb9-bebb-6531598a8880 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:33.016462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:17:33.017005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:17:33.017655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:17:33.018819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:17:33.019525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:17:33.044740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:33.045402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:33.047343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:33.048167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:33.089457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Getting quotas for project 556fc8a6a9084bbcac95337efe7e0c32. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:33.103569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Getting quotas for user aca9efe319004e748091a770c32c1ce8 and project 556fc8a6a9084bbcac95337efe7e0c32. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:33.116761 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:17:33.119981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:17:33.155560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-39843089-319c-4c8e-86ca-7faf1b6d18b6 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18ca8e50>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:33.256932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-39843089-319c-4c8e-86ca-7faf1b6d18b6 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 200 len: 346 microversion: 2.1 time: 0.107191 Oct 28 15:17:33.258334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 5/6] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:33 2021] GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:33.274096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ce4c5f43-c9dd-4e47-a1a7-c9d59214c0ac tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18ca8f70>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:33.350122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ce4c5f43-c9dd-4e47-a1a7-c9d59214c0ac tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 353 microversion: 2.1 time: 0.089981 Oct 28 15:17:33.359180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 6/7] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:33 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:33.359180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-10abd670-6c90-46a4-b1fb-827f80dfbfbb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Action: 'create', calling method: .version_select at 0x7fdc18ca84c0>, body: {"snapshot": {"volume_id": "51660d11-f5eb-42ae-aee3-dc973088f9a9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-560144017"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:33.391345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-09867aab-cfbb-42cf-93b4-99fca1c155d8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535976 Oct 28 15:17:33.397637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 2/8] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:17:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:17:33.397637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-629fdca2-7269-4cd1-9744-1480cfcad52d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18bae280>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:33.808713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-629fdca2-7269-4cd1-9744-1480cfcad52d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 353 microversion: 2.1 time: 0.415220 Oct 28 15:17:33.809768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 3/9] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:33 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 353 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:33.824420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-20283d16-6bdb-4f22-ac14-ee3faa22566e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:33.830707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-20283d16-6bdb-4f22-ac14-ee3faa22566e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:34.013675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-20283d16-6bdb-4f22-ac14-ee3faa22566e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:34.045281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-20283d16-6bdb-4f22-ac14-ee3faa22566e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1214 microversion: 2.1 time: 0.234314 Oct 28 15:17:34.046905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 4/10] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:33 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:34.052667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8a7b85ab-7f6a-4d34-8056-00ec128e11f2 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18bae790>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.151929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-10abd670-6c90-46a4-b1fb-827f80dfbfbb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.799115 Oct 28 15:17:34.157537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 7/11] 10.222.0.86 () {60 vars in 1161 bytes} [Thu Oct 28 15:17:33 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:34.162929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eefb8796-f2e3-4b92-b75e-76268c7bd5cb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18cb7280>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.478696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eefb8796-f2e3-4b92-b75e-76268c7bd5cb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.320014 Oct 28 15:17:34.479404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 8/12] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:34 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:34.489618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-097792d4-65a1-484c-a1b7-1b3d27f6577c tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc1962a3a0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.523793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8a7b85ab-7f6a-4d34-8056-00ec128e11f2 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 202 len: 0 microversion: 2.1 time: 0.475482 Oct 28 15:17:34.524439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 5/13] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:17:34 2021] DELETE /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:17:34.534675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b8731e68-b6a2-4a1f-9925-6ed4a1401db9 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc1835bb80>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.544482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-097792d4-65a1-484c-a1b7-1b3d27f6577c tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.058936 Oct 28 15:17:34.548425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 9/14] 10.222.0.86 () {58 vars in 1139 bytes} [Thu Oct 28 15:17:34 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:34.562265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e26bb1ba-7e1d-4e59-aaab-9d44d37e4bd2 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18ca8dc0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.605260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e26bb1ba-7e1d-4e59-aaab-9d44d37e4bd2 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.046522 Oct 28 15:17:34.606222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 10/15] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:34 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:34.619296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b8731e68-b6a2-4a1f-9925-6ed4a1401db9 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.090438 Oct 28 15:17:34.624544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 6/16] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:34 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:34.931178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-48f4e612-acda-4c9c-92bf-8a4844295d5c tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc18cb7790>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:34.980748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-48f4e612-acda-4c9c-92bf-8a4844295d5c tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/70f8cfcd-4c57-4eb0-a0c0-ad5f19105fc6" status: 200 len: 351 microversion: 2.1 time: 0.054133 Oct 28 15:17:34.987626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 11/17] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:34 2021] GET /compute/v2.1/os-volumes/70f8cfcd-4c57-4eb0-a0c0-ad5f19105fc6 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:35.065172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-986a4340-fdba-4e42-b46c-7c4d00eabe35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:35.105606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-986a4340-fdba-4e42-b46c-7c4d00eabe35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:35.181213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-986a4340-fdba-4e42-b46c-7c4d00eabe35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:35.187651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-986a4340-fdba-4e42-b46c-7c4d00eabe35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1214 microversion: 2.1 time: 0.128550 Oct 28 15:17:35.188451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 7/18] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:35 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:35.619620 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9c2ed033-0224-48da-a14b-6b136e542cdb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18decc10>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:35.633441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f389fe33-83d9-43e3-9d73-4cb0475163ba tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18340c10>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:35.759536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9c2ed033-0224-48da-a14b-6b136e542cdb tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.146400 Oct 28 15:17:35.760383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 12/19] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:35 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:35.814026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f389fe33-83d9-43e3-9d73-4cb0475163ba tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.184328 Oct 28 15:17:35.818865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 8/20] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:35 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:36.211467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:36.214272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:36.235873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:36.236527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:36.237534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:36.240613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:36.602278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:36.632783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2bcaf375-d5c8-4c76-a432-944b2fa1234a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1218 microversion: 2.1 time: 0.419803 Oct 28 15:17:36.632783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 13/21] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:36 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1218 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:36.771603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ba802665-ddc6-4e45-aa22-d81dfee9de7e tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc183711f0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:36.826571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9449caeb-b599-4123-98a0-c3ad7b903672 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18bd0280>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:36.830407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ba802665-ddc6-4e45-aa22-d81dfee9de7e tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.063022 Oct 28 15:17:36.831029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 9/22] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:36 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:36.889594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9449caeb-b599-4123-98a0-c3ad7b903672 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.066866 Oct 28 15:17:36.898714 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 14/23] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:36 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:37.646941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:37.647547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:37.663363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:37.664051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:37.665136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:37.665747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:37.844688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-317ea342-6004-468b-a846-a208738b9156 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18bc5790>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:37.868214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:37.912813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f0c2dfff-335c-409c-88bf-a9ea02c89e08 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1218 microversion: 2.1 time: 0.264077 Oct 28 15:17:37.912813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 10/24] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:37 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:37.923279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-317ea342-6004-468b-a846-a208738b9156 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.082256 Oct 28 15:17:37.923918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 15/25] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:37 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:37.928692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-490cc89b-f5a5-4a61-893d-78fe08bf25a2 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc182eaca0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:38.004095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-490cc89b-f5a5-4a61-893d-78fe08bf25a2 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.095253 Oct 28 15:17:38.005128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 11/26] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:37 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:38.456315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-558699806", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b4cfb2a-528c-4337-8cba-67365b64b43f"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:38.606625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] validate_networks() for [('2b4cfb2a-528c-4337-8cba-67365b64b43f', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:17:38.930741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:38.934286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:38.964818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:38.964818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:38.971091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:38.971091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:39.306547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:39.319372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5ed32247-8b67-46f2-82d3-d0e3b04cb74c tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1210 microversion: 2.1 time: 0.398919 Oct 28 15:17:39.320564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 12/27] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:38 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:39.327711 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fe844f8a-49f8-4341-8114-376830722f41 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182ea430>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:39.378988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fe844f8a-49f8-4341-8114-376830722f41 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.056864 Oct 28 15:17:39.386698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 13/28] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:39 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:39.405924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bdb82036-59be-44d0-940a-f055112c2189 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18371d30>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:39.466965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bdb82036-59be-44d0-940a-f055112c2189 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.079157 Oct 28 15:17:39.468033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 14/29] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:39 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:39.829504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:17:39.831214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:17:39.831909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:17:39.832496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:17:39.832909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:17:39.879641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:39.879641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:39.879641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:39.879641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:39.935156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Getting quotas for project 2eb43abf174b43e2960be3d166b34f86. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:39.944980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Getting quotas for user aae40a5606044eeb8a8694d05569f036 and project 2eb43abf174b43e2960be3d166b34f86. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:39.964077 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:17:39.972309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:17:40.194599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2e371fee-66ba-455c-abf2-2de9de55a151 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.871274 Oct 28 15:17:40.205329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 16/30] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:17:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 15:17:40.211793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b12ba9a5-0e65-452c-a65b-6332aaa8f717 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:40.212429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b12ba9a5-0e65-452c-a65b-6332aaa8f717 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:40.345154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b12ba9a5-0e65-452c-a65b-6332aaa8f717 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:40.375375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b12ba9a5-0e65-452c-a65b-6332aaa8f717 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1221 microversion: 2.1 time: 0.167690 Oct 28 15:17:40.379746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 17/31] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:40.387748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:40.389359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'create', calling method: .version_select at 0x7fdc18baedc0>, body: {"keypair": {"name": "tempest-keypair-377492745"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:40.396568 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:40.405073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:40.412346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:40.414126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:40.414126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:40.448202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:40.453090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:40.583284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:40.594333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-01c2bc37-7832-468a-8e14-18af2878572a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1266 microversion: 2.1 time: 0.213112 Oct 28 15:17:40.596854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 18/32] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:40 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:40.611018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-12d32712-584b-43c7-a0b7-6dcd395bf434 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182a3280>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:40.657203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-12d32712-584b-43c7-a0b7-6dcd395bf434 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 287 microversion: 2.1 time: 0.058004 Oct 28 15:17:40.664241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 19/33] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:40 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:40.667074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6960e939-b93f-433e-b9a3-fd4e03eb5e29 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc182a3670>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.005240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6960e939-b93f-433e-b9a3-fd4e03eb5e29 tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 200 len: 352 microversion: 2.1 time: 0.148090 Oct 28 15:17:41.005240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 20/34] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:40 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:41.005240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-283333955", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b4cfb2a-528c-4337-8cba-67365b64b43f"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:41.008566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:41.008566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:41.008566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-150e2fcb-9167-45a4-b7f7-3837ae6e58f0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.930034 Oct 28 15:17:41.008566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 15/35] 10.222.0.86 () {62 vars in 1198 bytes} [Thu Oct 28 15:17:39 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 932 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 28 15:17:41.008566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f5f7cfee-afa8-4740-835e-3e817a2a5cd5 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc1828d550>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.009739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] validate_networks() for [('2b4cfb2a-528c-4337-8cba-67365b64b43f', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:17:41.097216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f5f7cfee-afa8-4740-835e-3e817a2a5cd5 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "DELETE /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 202 len: 0 microversion: 2.1 time: 0.196476 Oct 28 15:17:41.097731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 16/36] 10.222.0.86 () {58 vars in 1253 bytes} [Thu Oct 28 15:17:40 2021] DELETE /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:17:41.107271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4dcf92cb-88ea-4f72-a665-f9af7ed6341d tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182a6b80>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.162322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4dcf92cb-88ea-4f72-a665-f9af7ed6341d tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 200 len: 286 microversion: 2.1 time: 0.056022 Oct 28 15:17:41.162322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 17/37] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:41.176912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d534185e-c7e6-4c56-8a6a-938e60329d76 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc182585e0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.256229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d534185e-c7e6-4c56-8a6a-938e60329d76 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/5788a378-d973-47f4-a8bb-087dbe0a96a1" status: 200 len: 350 microversion: 2.1 time: 0.083626 Oct 28 15:17:41.257283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 18/38] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/os-volumes/5788a378-d973-47f4-a8bb-087dbe0a96a1 => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:41.277973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-35dc1674-b09a-45eb-81d3-60f1dc265054 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc18258dc0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.462772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-35dc1674-b09a-45eb-81d3-60f1dc265054 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196426 Oct 28 15:17:41.464087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 19/39] 10.222.0.86 () {58 vars in 1133 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:41.485001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6facd3ed-35b8-48ad-bf88-9529dcfda5d3 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc1829b9d0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.677359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6facd3ed-35b8-48ad-bf88-9529dcfda5d3 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.202445 Oct 28 15:17:41.677990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 20/40] 10.222.0.86 () {58 vars in 1148 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:41.683914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:41.686724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:41.723109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:41.723787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:41.726684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:41.732093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:41.845092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:41.853869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6156520a-97ec-425d-861f-94de6a5086bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1272 microversion: 2.1 time: 0.174845 Oct 28 15:17:41.855012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 21/41] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:41.859509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7e544edb-e633-4b89-bfe6-69fa6d9fe7e9 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc1825f310>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.070453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7e544edb-e633-4b89-bfe6-69fa6d9fe7e9 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.169630 Oct 28 15:17:42.070453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 22/42] 10.222.0.86 () {58 vars in 1133 bytes} [Thu Oct 28 15:17:41 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:42.070453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8f740cb4-51e7-4c34-8f75-b6a84b2f676d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Calling method '.version_select at 0x7fdc18274670>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.098537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-8f740cb4-51e7-4c34-8f75-b6a84b2f676d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] HTTP exception thrown: Volume f3da4d3c-e771-4f08-b017-17fec05c2b38 could not be found. Oct 28 15:17:42.099406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8f740cb4-51e7-4c34-8f75-b6a84b2f676d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] Returning 404 to user: Volume f3da4d3c-e771-4f08-b017-17fec05c2b38 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:42.100503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8f740cb4-51e7-4c34-8f75-b6a84b2f676d tempest-VolumesGetTestJSON-959518479 tempest-VolumesGetTestJSON-959518479-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38" status: 404 len: 109 microversion: 2.1 time: 0.073113 Oct 28 15:17:42.101377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 23/43] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/os-volumes/f3da4d3c-e771-4f08-b017-17fec05c2b38 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:42.117072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7d427aec-0b6b-44b1-bb7d-9dc06f35a167 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc18274940>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.179321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:17:42.180358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:17:42.182204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:17:42.182874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:17:42.183392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:17:42.208898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:42.210399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:42.213319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:42.215052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:42.260978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Getting quotas for project 2eb43abf174b43e2960be3d166b34f86. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:42.272479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Getting quotas for user aae40a5606044eeb8a8694d05569f036 and project 2eb43abf174b43e2960be3d166b34f86. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:42.308900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:17:42.317018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:17:42.339072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7d427aec-0b6b-44b1-bb7d-9dc06f35a167 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.236366 Oct 28 15:17:42.348933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 24/44] 10.222.0.86 () {58 vars in 1166 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:42.348933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3536212c-0964-4d35-838f-dbab019f58f7 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc18377670>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.408166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-3536212c-0964-4d35-838f-dbab019f58f7 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] HTTP exception thrown: Snapshot 374a0068-ee6e-4f34-8ad2-52048c421164 could not be found. Oct 28 15:17:42.409632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3536212c-0964-4d35-838f-dbab019f58f7 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Returning 404 to user: Snapshot 374a0068-ee6e-4f34-8ad2-52048c421164 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:42.410758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3536212c-0964-4d35-838f-dbab019f58f7 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164" status: 404 len: 111 microversion: 2.1 time: 0.069242 Oct 28 15:17:42.411340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 25/45] 10.222.0.86 () {58 vars in 1250 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/os-snapshots/374a0068-ee6e-4f34-8ad2-52048c421164 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:42.416811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41014470-b259-4f4d-9251-16eb6c89a460 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc18258160>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.501286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-21f42114-f321-431c-8ca6-148ea5351ef2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.687265 Oct 28 15:17:42.503998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 21/46] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:17:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:17:42.525211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-188e40dd-5b34-4eca-97de-8a3b8370037e tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182a35e0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.631334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41014470-b259-4f4d-9251-16eb6c89a460 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.218844 Oct 28 15:17:42.640931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 26/47] 10.222.0.86 () {58 vars in 1169 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:42.645869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4afd4cac-d844-4943-b58e-7fdcb01bc59e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:42.646487 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4afd4cac-d844-4943-b58e-7fdcb01bc59e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:42.903945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-188e40dd-5b34-4eca-97de-8a3b8370037e tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 202 len: 0 microversion: 2.1 time: 0.396514 Oct 28 15:17:42.907968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 22/48] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:17:42 2021] DELETE /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:17:42.915719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2ff44059-2c1e-44c7-a081-56f0be62f787 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc182a3670>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:43.188070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2ff44059-2c1e-44c7-a081-56f0be62f787 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.278876 Oct 28 15:17:43.190061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 23/49] 10.222.0.86 () {58 vars in 1154 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:43.195638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:43.196733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:43.240179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:43.253587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:43.257674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:43.258505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:43.438175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4afd4cac-d844-4943-b58e-7fdcb01bc59e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:43.453965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4afd4cac-d844-4943-b58e-7fdcb01bc59e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1221 microversion: 2.1 time: 0.811819 Oct 28 15:17:43.473494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 27/50] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:42 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1221 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:43.487045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8ba6c23a-fc60-4cfd-b4db-04600bd26914 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182745e0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:43.562269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-8ba6c23a-fc60-4cfd-b4db-04600bd26914 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] HTTP exception thrown: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. Oct 28 15:17:43.563061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8ba6c23a-fc60-4cfd-b4db-04600bd26914 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Returning 404 to user: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:43.563682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8ba6c23a-fc60-4cfd-b4db-04600bd26914 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 404 len: 109 microversion: 2.1 time: 0.088900 Oct 28 15:17:43.564229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 28/51] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:43 2021] GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:43.578845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-310f050d-977d-4baf-9c4f-44c0aa4b1b8e tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc1825f3a0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:43.820637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-310f050d-977d-4baf-9c4f-44c0aa4b1b8e tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245589 Oct 28 15:17:43.822059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 29/52] 10.222.0.86 () {58 vars in 1187 bytes} [Thu Oct 28 15:17:43 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:17:43.837700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3602b614-6d6d-45fc-a870-6c9ea50b8428 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc1825f4c0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:43.937922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-3602b614-6d6d-45fc-a870-6c9ea50b8428 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] HTTP exception thrown: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. Oct 28 15:17:43.937922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3602b614-6d6d-45fc-a870-6c9ea50b8428 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Returning 404 to user: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:43.939868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3602b614-6d6d-45fc-a870-6c9ea50b8428 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 404 len: 109 microversion: 2.1 time: 0.115955 Oct 28 15:17:43.945173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 30/53] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:17:43 2021] DELETE /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:43.953756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ef7d0867-0112-48ff-9eae-cb528c7e3253 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] Calling method '.version_select at 0x7fdc1825f820>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:44.107651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:44.135765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-95569e01-fb1e-48f8-81d3-2aba0c551577 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.943779 Oct 28 15:17:44.144678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 24/54] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:43 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:44.209290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5bc83e1e-a95c-410a-bfd0-3f612e0b8c87 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Calling method '.version_select at 0x7fdc182a3820>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:44.302033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-5bc83e1e-a95c-410a-bfd0-3f612e0b8c87 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] HTTP exception thrown: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. Oct 28 15:17:44.302732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5bc83e1e-a95c-410a-bfd0-3f612e0b8c87 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] Returning 404 to user: Volume 51660d11-f5eb-42ae-aee3-dc973088f9a9 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:44.303833 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5bc83e1e-a95c-410a-bfd0-3f612e0b8c87 tempest-VolumesSnapshotsTestJSON-2103076363 tempest-VolumesSnapshotsTestJSON-2103076363-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9" status: 404 len: 109 microversion: 2.1 time: 0.132423 Oct 28 15:17:44.304722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 25/55] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:44 2021] GET /compute/v2.1/os-volumes/51660d11-f5eb-42ae-aee3-dc973088f9a9 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:44.458632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ef7d0867-0112-48ff-9eae-cb528c7e3253 tempest-VolumesTestJSON-1652377646 tempest-VolumesTestJSON-1652377646-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.496785 Oct 28 15:17:44.458632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 31/56] 10.222.0.86 () {58 vars in 1154 bytes} [Thu Oct 28 15:17:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:44.475371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:44.476365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:44.488912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:44.511200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:44.514587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:44.515166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:44.808291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:44.816295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0d27935f-d493-4092-9822-e27d29821b1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1225 microversion: 2.1 time: 0.346632 Oct 28 15:17:44.829100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 26/57] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:44 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1225 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:45.163426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:45.164078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:45.190222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:45.193455 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:45.197302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:45.198908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:45.846999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:45.847796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:45.871244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:45.890891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:45.895051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:45.897635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:46.187393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:46.209772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-da946ed7-fd7c-4eab-b749-27ecef4e84a1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 1.040851 Oct 28 15:17:46.211743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 32/58] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:45 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:46.494220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:46.515501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eb1c8dac-93d4-4e8b-bd06-9dbf18db0a3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1273 microversion: 2.1 time: 0.672511 Oct 28 15:17:46.531929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 27/59] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:45 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1273 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:17:47.241572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:47.243519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:47.274931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:47.287650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:47.300876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:47.302590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:47.535368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:47.536996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:47.548022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:47.548792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:47.549787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:47.550641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:47.887122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:47.903144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14243b94-034c-4a29-a6b6-3ddba4ec02cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1273 microversion: 2.1 time: 0.368652 Oct 28 15:17:47.908619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 28/60] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:47 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:48.312969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:48.326096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1ba81335-de97-477f-a645-426dfa8e4aeb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 1.093434 Oct 28 15:17:48.328018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 33/61] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:47 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:48.827512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1245029013", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adaae7dc-8ce6-4ed0-8c77-33a94b998a91"}], "security_groups": [{"name": "tempest-securitygroup--971868088"}], "key_name": "tempest-keypair-377492745", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:48.928299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:48.928299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:48.928299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:48.928299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:48.928610 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:48.929064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:49.084815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] validate_networks() for [('adaae7dc-8ce6-4ed0-8c77-33a94b998a91', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:17:49.176578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:49.202843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4fa1889c-74ae-49dc-a402-865aad02443a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.275847 Oct 28 15:17:49.202843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 34/62] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:48 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:49.351878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:49.352689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:49.380593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:49.381789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:49.382969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:49.383856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:49.750641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:49.752051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-45534787-9247-443d-b46a-278bb4475c15 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.406761 Oct 28 15:17:49.764426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 35/63] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:49 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:49.921982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-8dcf4580-11f6-4f0e-9a97-b907e6b2c987 req-1d2874b8-348d-4483-940a-30a24eb73d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84969cc-4f86-4c5d-ab37-08473a79a268", "tag": "16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:49.925787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:17:49.925787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:17:49.942853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:17:49.943983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:17:49.945249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:17:49.945697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:17:49.946321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:17:49.962912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8dcf4580-11f6-4f0e-9a97-b907e6b2c987 req-1d2874b8-348d-4483-940a-30a24eb73d8e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:49.963420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8dcf4580-11f6-4f0e-9a97-b907e6b2c987 req-1d2874b8-348d-4483-940a-30a24eb73d8e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:49.971817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:49.972765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:49.973769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:49.974502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.012457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-8dcf4580-11f6-4f0e-9a97-b907e6b2c987 req-1d2874b8-348d-4483-940a-30a24eb73d8e service nova] Creating event network-changed:16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c for instance a84969cc-4f86-4c5d-ab37-08473a79a268 on hv-cinder-78364 Oct 28 15:17:50.014971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:17:50.015729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8dcf4580-11f6-4f0e-9a97-b907e6b2c987 req-1d2874b8-348d-4483-940a-30a24eb73d8e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 15:17:50.019828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.020276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.021104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.021520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.022978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:17:50.031033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.compute.rpcapi [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 15:17:50.032303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] Releasing lock "compute-rpcapi-router" {{(pid=116432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 15:17:50.039475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:17:50.041937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:17:50.060099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-016ad8cd-35aa-4cc6-afa9-9f11321b23f9 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273879 Oct 28 15:17:50.061281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 36/64] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:17:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:17:50.236028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:50.236028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:50.236028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.236028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.236736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.236736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.320452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:50.346590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2a5177b3-2ae0-4342-ae06-e2a7ddb75575 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.132854 Oct 28 15:17:50.368380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 37/65] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:50 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:17:50.379228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2909d2b4-38f0-45ad-be1f-0ee160c01034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.556652 Oct 28 15:17:50.382206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 29/66] 10.222.0.86 () {62 vars in 1187 bytes} [Thu Oct 28 15:17:48 2021] POST /compute/v2.1/servers => generated 401 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 15:17:50.392253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:50.393829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:50.517841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:50.537878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:50.540929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:50.543157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-20b3d127-4ded-41c8-8563-9e2a22dc0232 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1281 microversion: 2.20 time: 0.154545 Oct 28 15:17:50.544061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 38/67] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:50 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:50.772625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:50.773557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:50.988740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.988740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.988740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:50.988740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:50.991648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:50.991648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-96e4b4e4-7739-4b4d-94e5-0177ce30665f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.181204 Oct 28 15:17:50.991648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 30/68] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:50 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:51.409235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:51.409235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:51.409235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:51.409235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:51.410704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:51.410704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:51.442597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:51.450667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9fd5ec2a-7bee-4071-8f9f-31354a27dd82 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.087364 Oct 28 15:17:51.451302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 39/69] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:51 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:51.580280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:51.580950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:51.822201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:51.822201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:51.823292 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:51.823292 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1016c79e-bf72-4646-87de-132fd7a86e88 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1281 microversion: 2.20 time: 0.169475 Oct 28 15:17:51.823292 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 31/70] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:51 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:51.994683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:51.995831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:52.003460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:52.004134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:52.005798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:52.006402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:52.199961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:52.214600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-829aad53-eaff-478e-ae65-cafae33950a2 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.223432 Oct 28 15:17:52.227157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 40/71] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:51 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:52.470842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:52.473623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:52.481894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:52.482844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:52.484170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:52.484953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:52.586441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:52.699023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bbe79962-8d32-4d10-b9e8-d53fd228beab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.130357 Oct 28 15:17:52.699023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 32/72] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:52 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:52.843784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:52.846273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:52.903919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:52.911282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:52.912844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:52.913955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-be0bb56b-518a-434a-a89b-9478fda9fdfc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1281 microversion: 2.20 time: 0.075013 Oct 28 15:17:52.915460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 41/73] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:52 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:53.231591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:53.232327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:53.239651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.249718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:53.249718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.249718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:53.402355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:53.410905 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62eea743-f01e-4ee1-9a53-754b27636da6 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.183667 Oct 28 15:17:53.411476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 33/74] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:53 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:53.611020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:53.611658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:53.620239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.620705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:53.621544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.621970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:53.692028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:53.699396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9eb71907-6b78-40d1-9345-a856f89ae782 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.092062 Oct 28 15:17:53.699943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 42/75] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:53 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:53.941757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:53.946989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:53.952783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.953740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:53.956060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:53.956619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:54.128250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:54.133655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:54.135162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:54.140004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2efbd3e0-c5f4-48b0-867a-c31d4ce2a024 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1285 microversion: 2.20 time: 0.203721 Oct 28 15:17:54.142613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 34/76] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:53 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:54.428284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:54.428914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:54.434940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:54.435517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:54.436351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:54.436875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:54.573866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:54.580981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2e909853-79eb-4486-b7d5-cfce367db3a3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.156929 Oct 28 15:17:54.581714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 43/77] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:54 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:54.716154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:54.716800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:54.723416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:54.735209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:54.735209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:54.735209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:54.823762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:54.832637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b7a0b0a8-ee1a-48f1-bd05-15523cca8b1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.120062 Oct 28 15:17:54.833577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 35/78] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:54 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:55.165102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:55.165712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:55.171698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.172226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.172938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.173366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.245219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:55.259520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:55.261179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:55.262783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3bb28ff4-1eed-42f3-8727-20be7075f16f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1285 microversion: 2.20 time: 0.107284 Oct 28 15:17:55.272480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 44/79] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:55 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:55.597932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:55.598684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:55.604820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.605349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.606190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.606669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.746181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:55.757595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-487d027c-02a4-475d-be04-ae954fd82a29 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.163570 Oct 28 15:17:55.758959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 36/80] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:55 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:55.851297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:55.851297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:55.856823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.857580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.858461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:55.858964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:55.920042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:55.927852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d815a2e8-6a58-4c49-bfa5-29437f64d785 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.082432 Oct 28 15:17:55.928426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 45/81] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:55 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:56.170827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-027da369-5750-450c-a52d-be1d4406f99e tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Action: 'create', calling method: .version_select at 0x7fdc182494c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-177027178", "metadata": {"Type": "work"}}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:56.170827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-027da369-5750-450c-a52d-be1d4406f99e tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.171897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-027da369-5750-450c-a52d-be1d4406f99e tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.319697 Oct 28 15:17:56.172950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 37/82] 10.222.0.86 () {60 vars in 1155 bytes} [Thu Oct 28 15:17:55 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:17:56.182001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cfd6a223-0a97-4fd3-b38a-342b6da00001 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Action: 'create', calling method: .version_select at 0x7fdc18377670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1281394954", "metadata": {"Type": "work"}}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:56.183934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cfd6a223-0a97-4fd3-b38a-342b6da00001 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.184948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cfd6a223-0a97-4fd3-b38a-342b6da00001 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006503 Oct 28 15:17:56.185657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 46/83] 10.222.0.86 () {60 vars in 1155 bytes} [Thu Oct 28 15:17:56 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:17:56.199615 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-80ed15cb-77dc-40b2-997e-bceb3fa571ee tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Action: 'create', calling method: .version_select at 0x7fdc182a3d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2065767515", "metadata": {"Type": "work"}}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:17:56.205850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-80ed15cb-77dc-40b2-997e-bceb3fa571ee tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.206650 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-80ed15cb-77dc-40b2-997e-bceb3fa571ee tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014792 Oct 28 15:17:56.207223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 38/84] 10.222.0.86 () {60 vars in 1155 bytes} [Thu Oct 28 15:17:56 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:17:56.216091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3806ea99-185b-42bc-92b4-8dc569ce6541 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Calling method '.version_select at 0x7fdc18274a60>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.253873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-3806ea99-185b-42bc-92b4-8dc569ce6541 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] HTTP exception thrown: Volume tempest-invalid-267639035 could not be found. Oct 28 15:17:56.254478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3806ea99-185b-42bc-92b4-8dc569ce6541 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 404 to user: Volume tempest-invalid-267639035 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.255560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3806ea99-185b-42bc-92b4-8dc569ce6541 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/tempest-invalid-267639035" status: 404 len: 98 microversion: 2.1 time: 0.042885 Oct 28 15:17:56.256092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 47/85] 10.222.0.86 () {58 vars in 1214 bytes} [Thu Oct 28 15:17:56 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-267639035 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 15:17:56.265774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4d7a32eb-fd65-42ee-a568-1badba0f24fb tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004477 Oct 28 15:17:56.266529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 39/86] 10.222.0.86 () {58 vars in 1139 bytes} [Thu Oct 28 15:17:56 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 15:17:56.275753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3a3f231f-7e5c-4d0e-9767-6cc7236c7f1d tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003839 Oct 28 15:17:56.282593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 48/87] 10.222.0.86 () {58 vars in 1136 bytes} [Thu Oct 28 15:17:56 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 15:17:56.283224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.284366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:56.290614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.291264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:56.291379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b661873f-27cd-4b4b-8e60-1c0fea0f44d9 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Calling method '.version_select at 0x7fdc1962c430>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.292282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.292891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:56.332783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-b661873f-27cd-4b4b-8e60-1c0fea0f44d9 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] HTTP exception thrown: Volume e5e3df9c-52a7-4899-9830-4cad46f5c245 could not be found. Oct 28 15:17:56.333392 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b661873f-27cd-4b4b-8e60-1c0fea0f44d9 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 404 to user: Volume e5e3df9c-52a7-4899-9830-4cad46f5c245 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.334249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b661873f-27cd-4b4b-8e60-1c0fea0f44d9 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/e5e3df9c-52a7-4899-9830-4cad46f5c245" status: 404 len: 109 microversion: 2.1 time: 0.047438 Oct 28 15:17:56.334774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 49/88] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:17:56 2021] DELETE /compute/v2.1/os-volumes/e5e3df9c-52a7-4899-9830-4cad46f5c245 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 15:17:56.356600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c678141-bd1d-40cf-8bd7-7613d4072169 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Calling method '.version_select at 0x7fdc1822a820>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.381862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:56.390864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:56.392384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:56.394140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d073ecbb-a50a-4cb2-9f07-21ed77cecca5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1285 microversion: 2.20 time: 0.114913 Oct 28 15:17:56.396983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-3c678141-bd1d-40cf-8bd7-7613d4072169 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] HTTP exception thrown: Volume 2a439a66-7a71-4e41-9761-1fe0b586a062 could not be found. Oct 28 15:17:56.397750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c678141-bd1d-40cf-8bd7-7613d4072169 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] Returning 404 to user: Volume 2a439a66-7a71-4e41-9761-1fe0b586a062 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:17:56.400598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3c678141-bd1d-40cf-8bd7-7613d4072169 tempest-VolumesNegativeTest-347449508 tempest-VolumesNegativeTest-347449508-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/2a439a66-7a71-4e41-9761-1fe0b586a062" status: 404 len: 109 microversion: 2.1 time: 0.058585 Oct 28 15:17:56.400598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 50/89] 10.222.0.86 () {58 vars in 1244 bytes} [Thu Oct 28 15:17:56 2021] GET /compute/v2.1/os-volumes/2a439a66-7a71-4e41-9761-1fe0b586a062 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:17:56.400743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 40/90] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:56 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:17:56.774880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.775478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:56.781418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.781813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:56.782552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.782969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:56.906964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:56.915597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f6b2392a-9882-4c7d-a230-d1462464141a tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.144200 Oct 28 15:17:56.916469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 51/91] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:56 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:56.944345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:56.944981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:56.951028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.951470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:56.952485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:56.952926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:57.017161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:57.025531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0af73acd-549a-4d46-9976-41d66a096a71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1281 microversion: 2.1 time: 0.085279 Oct 28 15:17:57.026396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 41/92] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:56 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:57.419847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:57.420573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:57.428290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:57.438731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:57.438731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:57.438731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:57.534837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:57.558808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:57.560326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:57.561907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8993a869-7a6d-4f8f-a49b-fd33148d774f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1285 microversion: 2.20 time: 0.145876 Oct 28 15:17:57.562454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 52/93] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:57 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:57.933352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:57.934253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:57.953043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:57.957375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:57.958748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:57.961406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:58.043731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:58.045255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:58.055178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:58.055957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:58.057006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:58.060050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:58.263026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:58.285641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8b620140-2364-45e0-b6e1-2f81a2111c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1291 microversion: 2.1 time: 0.246778 Oct 28 15:17:58.292463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 53/94] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:58 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1291 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:17:58.447052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:58.460247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9ddd49ff-347f-4f36-af5f-c60a42cead0f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.531665 Oct 28 15:17:58.465179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 42/95] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:57 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:58.585289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:58.586925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:58.593112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:58.595061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:58.597973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:58.597973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:58.690981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:58.706372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:58.712139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:58.715368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a99dcde9-5e26-486c-9d0a-bc72699e7e25 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1333 microversion: 2.20 time: 0.137998 Oct 28 15:17:58.716939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 54/96] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:58 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:17:59.313817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:59.315206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:59.323134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.323623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.324447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.324967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.398750 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:59.415456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-79db7650-58e8-497f-a1fa-c557032f04c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1279 microversion: 2.1 time: 0.105879 Oct 28 15:17:59.416207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 43/97] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:59 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:59.480863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:59.483171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:59.491261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.491808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.492891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.494823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.724670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:59.734782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:17:59.735399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:17:59.759075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9f1f97f3-6982-4a03-972e-09020609b060 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.284087 Oct 28 15:17:59.761884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.763441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.765010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:17:59.766314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:17:59.770237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 55/98] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:17:59 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:17:59.914522 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:59.933081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:59.947448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:17:59.964144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d6cde678-c5d5-40b2-94d2-d04fc4cac1ce tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1339 microversion: 2.20 time: 0.233703 Oct 28 15:17:59.974310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 44/99] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:17:59 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:00.157546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-444a869d-e6d6-4ed5-adbc-3e9556bd59bd req-496d291b-ea43-41d4-a908-35b02e1acd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13279aaf-dc79-4544-b2dc-8c5099d7b405", "tag": "fac61c7a-48c7-42f0-b93d-6b3cb97a91c9"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:00.161521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:00.161521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:00.177834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-444a869d-e6d6-4ed5-adbc-3e9556bd59bd req-496d291b-ea43-41d4-a908-35b02e1acd7a service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:00.182258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-444a869d-e6d6-4ed5-adbc-3e9556bd59bd req-496d291b-ea43-41d4-a908-35b02e1acd7a service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:00.211299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-444a869d-e6d6-4ed5-adbc-3e9556bd59bd req-496d291b-ea43-41d4-a908-35b02e1acd7a service nova] Creating event network-changed:fac61c7a-48c7-42f0-b93d-6b3cb97a91c9 for instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 on hv-cinder-78364 Oct 28 15:18:00.229441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-444a869d-e6d6-4ed5-adbc-3e9556bd59bd req-496d291b-ea43-41d4-a908-35b02e1acd7a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418421 Oct 28 15:18:00.231800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 56/100] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:17:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:00.434203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:00.434806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:00.444566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:00.445905 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:00.447562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:00.448908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:00.657673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:00.670244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eabbd6a8-7e6d-492d-a101-5b08234130a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.239868 Oct 28 15:18:00.672041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 45/101] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:00 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:00.779222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:00.780532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:00.804331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:00.805920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:00.808333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:00.811738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:00.986629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:00.988126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:01.001787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:01.030722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:01.030722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:01.030722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:01.258736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:01.286528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-520e40e6-d65f-4bc4-9196-4cf95336c87d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.513238 Oct 28 15:18:01.290274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 57/102] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:00 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:01.317159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:01.325824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:01.327389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:01.329026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6bc10e75-8669-4650-8b55-1690e7faa0e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.346108 Oct 28 15:18:01.329894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 46/103] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:00 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:01.482119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-2f1dc290-bff5-4724-903d-11d4b36753ea req-62f6f22c-d038-427d-8083-d9a8385979d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59063a8-b8d4-40b6-97e8-cbe60c3df84a", "tag": "d916c38b-451d-479f-a682-24e2eb78f02d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:01.484359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:01.484359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:01.501047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-2f1dc290-bff5-4724-903d-11d4b36753ea req-62f6f22c-d038-427d-8083-d9a8385979d0 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:01.501493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-2f1dc290-bff5-4724-903d-11d4b36753ea req-62f6f22c-d038-427d-8083-d9a8385979d0 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:01.525584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-2f1dc290-bff5-4724-903d-11d4b36753ea req-62f6f22c-d038-427d-8083-d9a8385979d0 service nova] Creating event network-changed:d916c38b-451d-479f-a682-24e2eb78f02d for instance e59063a8-b8d4-40b6-97e8-cbe60c3df84a on hv-cinder-78364 Oct 28 15:18:01.531345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-2f1dc290-bff5-4724-903d-11d4b36753ea req-62f6f22c-d038-427d-8083-d9a8385979d0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054971 Oct 28 15:18:01.532255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 58/104] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:01.688585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:01.689195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:01.699697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:01.700145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:01.701014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:01.701436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:01.970925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:01.981382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0e9954ed-d75d-4b06-a26a-bde8f214e0ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.294252 Oct 28 15:18:01.981382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 47/105] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:01 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:02.352419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:02.352419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:02.352419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:02.352419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:02.353097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:02.353097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:02.362055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:02.363399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:02.379309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:02.380333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:02.382747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:02.384002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:02.585454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:02.595518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d7e13625-941f-4933-a866-aea2bee9742f tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.292616 Oct 28 15:18:02.596264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 59/106] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:02 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:02.626746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:02.637017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:02.638697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:02.639787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c19256c0-be8c-4233-b1dd-17d38cb427b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.295991 Oct 28 15:18:02.640345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 48/107] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:02 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:02.817074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-e922706e-c9ea-4381-bfe1-ffbf76620026 req-bbb1b844-ce60-4ad4-8044-008c1411f594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc888dd6-aa57-4e8e-9d1b-9a38b32f3597", "tag": "85c34099-a099-4021-9a51-9f8fd2eb32a5"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:02.819074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:02.819074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:02.840930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e922706e-c9ea-4381-bfe1-ffbf76620026 req-bbb1b844-ce60-4ad4-8044-008c1411f594 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:02.841904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e922706e-c9ea-4381-bfe1-ffbf76620026 req-bbb1b844-ce60-4ad4-8044-008c1411f594 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:02.863195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-e922706e-c9ea-4381-bfe1-ffbf76620026 req-bbb1b844-ce60-4ad4-8044-008c1411f594 service nova] Creating event network-changed:85c34099-a099-4021-9a51-9f8fd2eb32a5 for instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 on hv-cinder-78364 Oct 28 15:18:02.870104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-e922706e-c9ea-4381-bfe1-ffbf76620026 req-bbb1b844-ce60-4ad4-8044-008c1411f594 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058309 Oct 28 15:18:02.871372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 60/108] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:02.998836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:03.000007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:03.006957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.007397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.008252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.008712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.156537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:03.165735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e55ca151-e5a8-472f-8da7-6ec6bb69816e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.170542 Oct 28 15:18:03.166463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 49/109] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:02 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:03.613452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:03.614068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:03.620058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.620534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.621293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.621720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.658923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:03.659599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:03.666472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.666995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.668407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:03.668407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:03.793524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:03.802461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d65d451d-f51a-408f-be55-ff7b0ba90c98 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.193545 Oct 28 15:18:03.803933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 61/110] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:03 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:03.829659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:03.837273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:03.838768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:03.839873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d99afb25-7dc9-4a91-9cb2-14285bdcd6bb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.184785 Oct 28 15:18:03.840434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 50/111] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:03 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:04.182852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:04.183509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:04.189430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.196264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:04.196264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.196264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:04.327797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:04.335381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-666eb5db-fc62-4f22-8564-6258a7f60d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.156202 Oct 28 15:18:04.335932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 62/112] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:04 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:04.822335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:04.826034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:04.832774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.833540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:04.834539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.835177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:04.860671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:04.861278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:04.874864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.875313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:04.876075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:04.876522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:05.027603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:05.034970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-606b6dfe-3bcf-408b-bcc0-d5d9e070de90 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.216585 Oct 28 15:18:05.045009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 51/113] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:04 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:05.087681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:05.099135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:05.100722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:05.102271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0cd29dcd-4b42-4169-ad6f-161ea026e2ec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.247630 Oct 28 15:18:05.103080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 63/114] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:04 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:05.351746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:05.352344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:05.358854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:05.359627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:05.360647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:05.361258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:05.647103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:05.655020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-047fb0e5-69f4-4a65-bf13-fe87fd1fd4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.306872 Oct 28 15:18:05.658832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 52/115] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:05 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:06.053111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:06.054430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:06.073791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.076115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.076954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.077510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.119605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:06.121013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:06.139050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.139483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.140235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.140679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.255168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:06.264276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cedc088d-b882-4c99-b08e-90b9f1c8ce1b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.216811 Oct 28 15:18:06.265391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 64/116] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:06 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:06.308614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:06.316793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:06.318192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:06.319270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62d1a0c1-883b-45bb-8752-4afe2619e697 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.203792 Oct 28 15:18:06.319813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 53/117] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:06 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:06.672435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:06.673049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:06.682821 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.691480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.691480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:06.691480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:06.865777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:06.873130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f1960c6a-b7d8-4c18-858f-6c3ba313af86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.204417 Oct 28 15:18:06.873956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 65/118] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:06 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:07.282539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:07.284040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:07.296281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.296991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:07.298758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.300948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:07.337774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:07.339099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:07.348754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.351952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:07.353044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.354380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:07.728087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:07.735187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:07.745087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8bc629e8-b542-42b9-90d9-de5eaccca732 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.459574 Oct 28 15:18:07.748271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 54/119] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:07 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:07.753239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:07.754776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:07.756129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b7e05bdf-efff-4185-bb29-663f9eac5683 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.422160 Oct 28 15:18:07.756723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 66/120] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:07 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:07.906111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:07.906111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:07.911664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.912110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:07.912916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:07.913336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:08.076740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:08.085247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4157c786-bb8d-4d42-984e-28ec3efae203 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.196310 Oct 28 15:18:08.085799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 55/121] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:07 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:08.755472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:08.756492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:08.764721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:08.765502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:08.767078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:08.771396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:08.773910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:08.775191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:08.791195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:08.791639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:08.792441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:08.792870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:08.979005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:08.986139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:08.987351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-688e4bf7-3ef7-45e6-8efc-d03c38685dd3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.236529 Oct 28 15:18:08.987931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 67/122] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:08 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:08.994450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:08.996178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:08.997510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e3c1e466-667d-4c03-abaa-974178e73510 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.227200 Oct 28 15:18:08.998131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 56/123] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:08 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:09.101302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:09.101935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:09.107988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:09.108459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:09.109224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:09.109650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:09.229496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:09.236667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-def7be66-8e1d-4f37-aa55-97e1d5b1fb16 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.139004 Oct 28 15:18:09.237226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 68/124] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:09 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:10.003809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:10.004546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:10.011919 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.013039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.014010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.014637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.016577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:10.018020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:10.025694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.025999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.026788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.027441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.292550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:10.300235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:10.301769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:10.302863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-69b689e3-3035-48d5-8ec0-f8389f22c2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.290985 Oct 28 15:18:10.303328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:10.303469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 69/125] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:10 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:10.311144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a627d75c-6ccf-4534-bfc3-30fa3f6a52e3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.310970 Oct 28 15:18:10.311696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 57/126] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:09 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:10.327556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:10.327556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:10.334782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.335424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.336542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:10.337114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:10.482003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:10.490707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b763d8a0-b09b-4b04-a2fc-29f6b3fa32b7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.169187 Oct 28 15:18:10.491600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 70/127] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:10 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:11.327011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:11.327614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:11.334076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.334728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.335703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.336330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.337744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:11.338362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:11.344762 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.345435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.346384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.347031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.527068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:11.539112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:11.540126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:11.541704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:11.543548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-905e4528-0230-4db1-81cc-ff40025f6d46 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.211446 Oct 28 15:18:11.545225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 71/128] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:11 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:11.548697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b5c76249-a54b-4aee-b88a-877d880a3c71 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.225105 Oct 28 15:18:11.550227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:11.551181 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:11.551299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 58/129] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:11 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:11.557667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.558103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.559059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:11.559688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:11.714771 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:11.723678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-46e0102e-fe81-47c2-9e2f-670ed67e6bd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.177174 Oct 28 15:18:11.734007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 72/130] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:11 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:12.567209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:12.568051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:12.570427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:12.571330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:12.579899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.583436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.584072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.584773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.585653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.586605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.587296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.587811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.773464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:12.779782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:12.781159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-440e9696-7fe9-45d4-a313-9c86643451ce tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.219750 Oct 28 15:18:12.781737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 73/131] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:12 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:12.785933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:12.786758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:12.791097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:12.792288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.792765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.792880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:12.793563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:12.793991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:12.794112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6a994a0a-5e92-4f87-8659-62d482ca458a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.236443 Oct 28 15:18:12.794666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 59/132] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:12 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:12.915391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:12.922707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-44722043-3ac1-41ee-b216-34568f849714 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.140040 Oct 28 15:18:12.923273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 74/133] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:12 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:13.801723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:13.802331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:13.808683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:13.809116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:13.816529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:13.817213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:13.887110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-0e130368-815e-403e-863d-baf77217e9a4 req-dcacc5c7-afad-4038-9dd7-1652b3f25c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13279aaf-dc79-4544-b2dc-8c5099d7b405", "name": "network-vif-plugged", "status": "completed", "tag": "fac61c7a-48c7-42f0-b93d-6b3cb97a91c9"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:13.888672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:13.888672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:13.896686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-0e130368-815e-403e-863d-baf77217e9a4 req-dcacc5c7-afad-4038-9dd7-1652b3f25c1b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:13.897123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-0e130368-815e-403e-863d-baf77217e9a4 req-dcacc5c7-afad-4038-9dd7-1652b3f25c1b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:13.908635 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-0e130368-815e-403e-863d-baf77217e9a4 req-dcacc5c7-afad-4038-9dd7-1652b3f25c1b service nova] Creating event network-vif-plugged:fac61c7a-48c7-42f0-b93d-6b3cb97a91c9 for instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 on hv-cinder-78364 Oct 28 15:18:13.924305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-0e130368-815e-403e-863d-baf77217e9a4 req-dcacc5c7-afad-4038-9dd7-1652b3f25c1b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103974 Oct 28 15:18:13.924305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 75/134] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:18:13.924305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:13.924305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:13.930098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:13.930539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:13.931309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:13.931983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:13.995446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:14.003705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ed977295-a282-4163-b16d-f6f86c026004 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.209591 Oct 28 15:18:14.013871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 60/135] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:13 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:14.019397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:14.020290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:14.026370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:14.026869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:14.027810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:14.028232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:14.140244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:14.148577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:14.150158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:14.151246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-481a732d-cebc-4310-84fa-1afb8e330b96 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.234591 Oct 28 15:18:14.151816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 76/136] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:13 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:14.189849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:14.197500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-749762dd-4ed7-4faf-adcf-7a151d94d1ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.182316 Oct 28 15:18:14.198051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 61/137] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:14 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:15.021261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:15.021868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:15.027657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.028106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.028907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.029335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.146002 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:15.153100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c4b58932-82f9-441c-b23e-f8f17af58de1 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.135980 Oct 28 15:18:15.153652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 77/138] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:15 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:15.168676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:15.169348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:15.175464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.175893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.177248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.177248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.214223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:15.215130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:15.221547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.227312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.228148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.228611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.328232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:15.336960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:15.338543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:15.339639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8e0e5a87-a70e-4352-b984-98c1f42dafe7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.174670 Oct 28 15:18:15.340166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 62/139] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:15 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:15.389822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:15.397773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4e8820d5-dae4-420c-8564-82d467b724bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.187415 Oct 28 15:18:15.407657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 78/140] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:15 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:15.931013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-26dd373a-5397-4a04-8325-15bc79953751 req-b8ef35f3-481f-4af5-a8e2-6788fe27ff75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84969cc-4f86-4c5d-ab37-08473a79a268", "name": "network-vif-plugged", "status": "completed", "tag": "16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:15.933271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:15.933271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:18:15.943549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-26dd373a-5397-4a04-8325-15bc79953751 req-b8ef35f3-481f-4af5-a8e2-6788fe27ff75 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.944076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-26dd373a-5397-4a04-8325-15bc79953751 req-b8ef35f3-481f-4af5-a8e2-6788fe27ff75 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.966903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-26dd373a-5397-4a04-8325-15bc79953751 req-b8ef35f3-481f-4af5-a8e2-6788fe27ff75 service nova] Creating event network-vif-plugged:16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c for instance a84969cc-4f86-4c5d-ab37-08473a79a268 on hv-cinder-78364 Oct 28 15:18:15.966903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-26dd373a-5397-4a04-8325-15bc79953751 req-b8ef35f3-481f-4af5-a8e2-6788fe27ff75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 15:18:15.966903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.966903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.966903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:15.967392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:15.974455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.compute.rpcapi [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 15:18:15.975299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] Releasing lock "compute-rpcapi-router" {{(pid=116431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 15:18:16.001277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0d703b0b-2a6b-4380-a7f5-a04a0461e60e None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073828 Oct 28 15:18:16.001871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 63/141] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:16.171889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:16.171889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:16.177506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.177937 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.178697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.179119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.312343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:16.317042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-eb6cacab-60cb-4d1e-8701-7998baf7610b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.150449 Oct 28 15:18:16.317603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 79/142] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:16 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:16.358631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:16.359389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:16.366783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.367395 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.368174 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.415539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:16.416252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:16.422374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.422814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.423611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:16.424070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:16.591208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:16.600229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:16.602448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:16.604263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7acd37ea-e1c4-4961-bc30-ee284aa7e3b8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.250023 Oct 28 15:18:16.615534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 64/143] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:16 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:16.625676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:16.634032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3ca56764-fba7-4c47-9ca1-aca59ad9e0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.222352 Oct 28 15:18:16.634665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 80/144] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:16 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:17.339227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:17.340032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:17.348163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.349668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.351150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.351929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.493487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:17.502875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-21a0fd33-14c2-4eeb-972c-06eb09ece2b0 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.170147 Oct 28 15:18:17.503444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 65/145] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:17 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:17.622384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:17.623151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:17.630289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.630911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.632088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.632759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.652276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:17.653094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:17.662895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.663328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.664221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:17.664673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:17.823744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:17.833156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:17.834811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:17.835968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-19b8e013-1f75-4f18-ad2e-daea5cffea94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.217892 Oct 28 15:18:17.836869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 81/146] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:17 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:17.854019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:17.862870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a2749462-9c05-44e4-b2c4-5afa7b7f7b3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.214296 Oct 28 15:18:17.863573 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 66/147] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:17 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:18.019862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-d9ce321d-12d9-4719-83b0-bb54ef29396f req-6b43decc-ee6e-47dd-bb8a-7652942e5aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59063a8-b8d4-40b6-97e8-cbe60c3df84a", "name": "network-vif-plugged", "status": "completed", "tag": "d916c38b-451d-479f-a682-24e2eb78f02d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:18.022311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:18.022311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:18.028946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-d9ce321d-12d9-4719-83b0-bb54ef29396f req-6b43decc-ee6e-47dd-bb8a-7652942e5aa5 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.029543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-d9ce321d-12d9-4719-83b0-bb54ef29396f req-6b43decc-ee6e-47dd-bb8a-7652942e5aa5 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.040195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-d9ce321d-12d9-4719-83b0-bb54ef29396f req-6b43decc-ee6e-47dd-bb8a-7652942e5aa5 service nova] Creating event network-vif-plugged:d916c38b-451d-479f-a682-24e2eb78f02d for instance e59063a8-b8d4-40b6-97e8-cbe60c3df84a on hv-cinder-78364 Oct 28 15:18:18.045010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-d9ce321d-12d9-4719-83b0-bb54ef29396f req-6b43decc-ee6e-47dd-bb8a-7652942e5aa5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029326 Oct 28 15:18:18.045586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 82/148] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:18.520370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:18.521006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:18.526674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.527116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.527886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.528315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.661487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:18.668670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8297caf6-4445-47fc-9fbc-8718a32985f8 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.152590 Oct 28 15:18:18.669230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 67/149] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:18 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:18.854557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:18.855152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:18.860984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.861416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.862657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.863076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.880117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:18.881032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:18.892181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.892999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:18.894134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:18.894803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:19.244894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:19.253120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:19.254866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:19.256746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d6de5e6-789e-4f5d-952f-42483486aafa tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.406248 Oct 28 15:18:19.257243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 83/150] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:18 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:19.258738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:19.266207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-edaff6e6-4fe1-4372-a14e-52d1f7301b31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.390363 Oct 28 15:18:19.267120 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 68/151] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:18 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:19.686309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:19.686911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:19.693242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:19.693687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:19.694449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:19.694873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:19.818402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:19.825612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-469d1a4f-cf70-4a7e-96bd-a38da173fa97 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.143116 Oct 28 15:18:19.826166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 84/152] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:19 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:20.275206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:20.275699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:20.282216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.282568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:20.283045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.283208 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:20.283424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.283840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.289519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.289961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.290713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.291140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.468687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:20.474250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:20.476578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:20.478068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:20.479159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd9203c1-417b-4816-aafd-232ed0f2f034 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.207685 Oct 28 15:18:20.479713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 69/153] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:20 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:20.481568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cc4429fc-f38f-424d-83e0-3ca148b5b8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.202605 Oct 28 15:18:20.482124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 85/154] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:20 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:20.843057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:20.843661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:20.849538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.850094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.850847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:20.851271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:20.975489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:20.985256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0ab98491-2087-406a-83c8-63b221904f38 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.145929 Oct 28 15:18:20.985826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 70/155] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:20 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:21.498225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:21.498912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:21.501714 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:21.502317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:21.506500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:21.507441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:21.508511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:21.508842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:21.509037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:21.509279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:21.510033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:21.510460 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:21.682098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:21.689943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:21.697495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:21.697495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8272563c-b51a-46c7-bcc2-76194fa78452 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.198082 Oct 28 15:18:21.697495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 86/156] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:21 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:21.697901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:21.701372 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9bbf9763-76a9-4c32-a63c-2dd7a9df70e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.203252 Oct 28 15:18:21.701916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 71/157] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:21 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:22.002091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:22.002686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:22.008848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.015236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.015236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.015236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.128554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:22.136109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-55d00a72-0a4f-49c2-a8a6-30e5bb4ab666 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1314 microversion: 2.1 time: 0.137614 Oct 28 15:18:22.136665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 87/158] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:21 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:22.714672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:22.715925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:22.718373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:22.719046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:22.724359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.725082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.725494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.726003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.726462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.727102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.727569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:22.728066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:22.918921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:22.922436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:22.927485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:22.929422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:22.930031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-76ae93de-f71c-489d-a62b-a24981ca1d1c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.215363 Oct 28 15:18:22.930592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 88/159] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:22 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:22.936929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a7fc1c39-09ae-4632-b75f-f219c601602a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.220333 Oct 28 15:18:22.937562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 72/160] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:22 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:23.153217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:23.153809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:23.160415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.160933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:23.161724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.162157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:23.287857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:23.295058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-08532389-0687-4fc4-890f-e5e0a43fc244 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1500 microversion: 2.1 time: 0.145566 Oct 28 15:18:23.295733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 89/161] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:23 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1500 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:23.946655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:23.947338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:23.954058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.954521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:23.955268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.955712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:23.959165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:23.962908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:23.966351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.967203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:23.968042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:23.968584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:24.136725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:24.144415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b85eed4b-b35f-4eea-a5ae-16df35ff1201 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.201393 Oct 28 15:18:24.148699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:24.149400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 73/162] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:23 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:24.154081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:24.156042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:24.157138 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e664a61c-a6b2-4ff1-91f3-08bd44f50d70 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.202939 Oct 28 15:18:24.157685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 90/163] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:23 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:24.963681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-96cf8efc-a3c6-476a-9c9d-c6a33d504504 req-a7fe4aa5-efe6-4822-9c6a-2cfc108126de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc888dd6-aa57-4e8e-9d1b-9a38b32f3597", "name": "network-vif-plugged", "status": "completed", "tag": "85c34099-a099-4021-9a51-9f8fd2eb32a5"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:24.965278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:24.965278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:18:24.972890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-96cf8efc-a3c6-476a-9c9d-c6a33d504504 req-a7fe4aa5-efe6-4822-9c6a-2cfc108126de service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:24.973314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-96cf8efc-a3c6-476a-9c9d-c6a33d504504 req-a7fe4aa5-efe6-4822-9c6a-2cfc108126de service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:24.983767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-96cf8efc-a3c6-476a-9c9d-c6a33d504504 req-a7fe4aa5-efe6-4822-9c6a-2cfc108126de service nova] Creating event network-vif-plugged:85c34099-a099-4021-9a51-9f8fd2eb32a5 for instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 on hv-cinder-78364 Oct 28 15:18:24.988603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-96cf8efc-a3c6-476a-9c9d-c6a33d504504 req-a7fe4aa5-efe6-4822-9c6a-2cfc108126de service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028474 Oct 28 15:18:24.989166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 74/164] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:25.160769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:25.161417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:25.167133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:25.167571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:25.168337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:25.168798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:25.177521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:25.178596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:25.196516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:25.197033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:25.200046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:25.200838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:25.337361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:25.344363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d565439a-0395-463e-80b5-f9816daece71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1321 microversion: 2.1 time: 0.187170 Oct 28 15:18:25.344947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 91/165] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:25 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:25.390179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:25.399765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:25.401380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:25.402776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d2f6b98a-4961-4923-b0c0-69eb9ab45400 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.231438 Oct 28 15:18:25.403520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 75/166] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:25 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:26.361065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:26.361674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:26.367504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.367940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.368728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.369155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.426956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:26.428091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:26.433415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.433844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.434591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.435007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.519196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:26.526640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3b17544d-639d-4da3-9295-741f80a7bb1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1514 microversion: 2.1 time: 0.169205 Oct 28 15:18:26.527280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 92/167] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:26 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:26.544449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:26.545724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:26.555405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.555405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.555405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.555405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.576657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:26.585231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:26.586721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:26.587797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fc2109f3-4935-4ead-9b48-1492f1346aef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.164624 Oct 28 15:18:26.598527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 76/168] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:26 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:26.614710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lazy-loading 'flavor' on Instance uuid e59063a8-b8d4-40b6-97e8-cbe60c3df84a {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:18:26.822776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2143dfd6-55b5-4965-aafc-42602cdf83e4"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:26.827305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:26.833960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.834396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:26.835156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:26.835576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:27.145563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a727f20a-3d2d-4e3e-ae99-f85c8998c603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a/action" status: 200 len: 32 microversion: 2.1 time: 0.605011 Oct 28 15:18:27.146184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 93/169] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:18:26 2021] POST /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a/action => generated 32 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 15:18:27.155413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:27.156160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:27.163180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:27.163853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:27.164790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:27.165398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:27.291027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:27.298382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-442d65e6-cb99-4dea-8810-e3d13a0a6283 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.147023 Oct 28 15:18:27.300093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 94/170] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:27 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:27.605970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:27.606624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:27.613179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:27.613550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:27.614319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:27.614746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:27.754706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:27.768134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:27.771329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:27.772769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8d0c879c-409e-494d-b058-9876581b1272 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1406 microversion: 2.20 time: 0.170534 Oct 28 15:18:27.773401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 95/171] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:27 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:18:28.332955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:28.335136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:28.353298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.354094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:28.355659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.356292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:28.489192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:28.497245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-10a764d5-2c14-4464-b3b5-46a4461e5d97 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.182593 Oct 28 15:18:28.497752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 96/172] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:28 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:28.791959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:28.795755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:28.802141 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.802638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:28.803475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.803894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:28.937855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:28.946873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:28.948358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:28.949873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e40212ab-911c-44ce-aadf-fa42cac5d301 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1598 microversion: 2.20 time: 0.162345 Oct 28 15:18:28.950583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 97/173] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:18:28 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:18:28.970476 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:28.970963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:28.977305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.977744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:28.978505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:28.978932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:29.073723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d5d5b95f-2e32-4fd1-88bf-e7d42243d1e2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107961 Oct 28 15:18:29.074406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 98/174] 10.222.0.86 () {60 vars in 1315 bytes} [Thu Oct 28 15:18:28 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:18:29.217096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60bebb75-a057-43f8-92b8-8ef4df5f5d35 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "POST /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.393291 Oct 28 15:18:29.217096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 77/175] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:18:26 2021] POST /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268/os-volume_attachments => generated 194 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:18:29.514843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:29.515599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:29.521748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:29.522287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:29.523273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:29.523823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:29.701573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:29.708781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-13f0b472-57f2-46cb-96d1-5a579fc3f641 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.197590 Oct 28 15:18:29.709342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 99/176] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:29 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:30.584754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:30.586295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:30.586734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-5be33e96-6bbb-4462-9658-da4757f25b05 req-caeb1747-ec6c-4666-bfff-7b33c14b983c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc888dd6-aa57-4e8e-9d1b-9a38b32f3597", "tag": "85c34099-a099-4021-9a51-9f8fd2eb32a5"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:30.588565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:18:30.588565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:18:30.592563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:30.593009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:30.593943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:30.594524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:30.595975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-5be33e96-6bbb-4462-9658-da4757f25b05 req-caeb1747-ec6c-4666-bfff-7b33c14b983c service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:30.596529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-5be33e96-6bbb-4462-9658-da4757f25b05 req-caeb1747-ec6c-4666-bfff-7b33c14b983c service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:30.607352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-5be33e96-6bbb-4462-9658-da4757f25b05 req-caeb1747-ec6c-4666-bfff-7b33c14b983c service nova] Creating event network-changed:85c34099-a099-4021-9a51-9f8fd2eb32a5 for instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 on hv-cinder-78364 Oct 28 15:18:30.612327 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-5be33e96-6bbb-4462-9658-da4757f25b05 req-caeb1747-ec6c-4666-bfff-7b33c14b983c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029769 Oct 28 15:18:30.613273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 100/177] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:18:30.726846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:30.727688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:30.733815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:30.734301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:30.735126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:30.735560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:30.865385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:30.872269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-46cbd7b7-b131-4a26-ae00-8fbc92054ec3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.149965 Oct 28 15:18:30.873077 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 101/178] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:30 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:31.889332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:31.889885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:31.895842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:31.896285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:31.897078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:31.897497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:32.043080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:32.053854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b7d00975-d9c9-40a4-ab8c-74646c72825a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.166383 Oct 28 15:18:32.057107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 102/179] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:31 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:33.070416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:33.071135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:33.077017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:33.077464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:33.078217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:33.078645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:33.210544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:33.218361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d7cacffc-9476-4267-85d9-227928caae3f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.151466 Oct 28 15:18:33.224450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 103/180] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:33 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:34.114979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8d7779af-1413-4193-bd25-de87a8b9e370 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 3.535368 Oct 28 15:18:34.118296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 78/181] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:30 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 3537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:34.234883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:34.238585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:34.242436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:34.246029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:34.246029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:34.246029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:34.391218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:34.398709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-00f49be1-c49e-40d5-ab57-d6f638e789bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.167584 Oct 28 15:18:34.399492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 104/182] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:34 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:35.127510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:35.128010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:35.135332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:35.135767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:35.136774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:35.137195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:35.223807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-39210d21-e76a-4d2c-a3df-a9eb15868d04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.100929 Oct 28 15:18:35.224466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 79/183] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:35 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:35.415510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:35.416157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:35.421782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:35.425702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:35.425702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:35.425702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:35.547702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:35.555418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b6e25614-af1f-428c-a2c1-f3267fe8c099 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.143524 Oct 28 15:18:35.555974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 105/184] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:35 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:36.234949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:36.235929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:36.244220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:36.244883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:36.245633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:36.246055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:36.324464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f318f22e-024f-4d94-867f-600eaefa40f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.093430 Oct 28 15:18:36.325100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 80/185] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:36 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:36.571878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:36.572612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:36.578646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:36.579062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:36.579814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:36.580233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:36.699326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:36.706964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6416eb95-9e54-45c3-9c28-226f08c93c5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.138803 Oct 28 15:18:36.707523 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 106/186] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:36 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:37.336377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:37.337399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:37.344131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:37.344616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:37.345370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:37.345794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:37.423611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b84a0dea-0bc7-42a1-9c5b-cffbdfbbe5c1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.091064 Oct 28 15:18:37.424278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 81/187] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:37 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:37.723018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:37.723618 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:37.752709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:37.752709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:37.752709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:37.752709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:37.894840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:37.902020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6ed72661-467f-4e10-baba-b056536654f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.182656 Oct 28 15:18:37.902573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 107/188] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:37 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:38.435271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:38.436415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:38.443161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:38.443600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:38.444485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:38.444976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:38.525964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d0506e8f-b82d-4a4c-bb30-6d57eb0190c8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.094531 Oct 28 15:18:38.531219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 82/189] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:38 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:38.919105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:38.919712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:38.925451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:38.925886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:38.926631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:38.927053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:39.055092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:39.062447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-756233f7-fbc6-4029-ab37-5618a40280cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.147046 Oct 28 15:18:39.063013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 108/190] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:38 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:39.540991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:39.548014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:39.548936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:39.549377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:39.550745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:39.551175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:40.078772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:40.079366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:40.100870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:40.100870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:40.100870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:40.100870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:40.216268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:40.224655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-58f6b09b-2787-4182-9b8a-f1d2b351c679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.149226 Oct 28 15:18:40.225720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 109/191] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:40 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:41.241687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:41.242300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:41.247954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:41.248458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:41.249244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:41.249674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:41.370732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:41.378112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b4f59a3f-fcb6-482c-80f8-9c6c0bf6df7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.140119 Oct 28 15:18:41.378685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 110/192] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:41 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:42.395418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:42.395979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:42.401838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:42.402269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:42.403012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:42.403427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:42.532302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:42.540868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c423724a-5464-4124-a896-9e37e5c805fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.148953 Oct 28 15:18:42.541947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 111/193] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:42 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:43.558185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:43.558905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:43.564919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:43.566430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:43.566790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:43.567215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:43.684983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:43.692890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e195f544-b9ee-4b8b-9fa1-79220cfdad39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.138478 Oct 28 15:18:43.693514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 112/194] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:43 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:44.511870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-68a0d756-0f12-4b45-882d-5d3371cbc2eb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 4.974716 Oct 28 15:18:44.515077 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 83/195] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:39 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 4977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:44.712736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:44.713425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:44.719130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:44.719555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:44.720298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:44.720739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:44.839254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:44.847027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-089a48e3-83b1-47fb-903c-fe1769bf0cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.137300 Oct 28 15:18:44.847604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 113/196] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:44 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:45.523347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:45.524347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:45.530520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:45.530969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:45.531731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:45.532158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:45.607406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f38fba8c-d0d5-4c6d-9ab3-77839ddda4b2 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.089042 Oct 28 15:18:45.608231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 84/197] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:45 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:45.863649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:45.864185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:45.870113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:45.870538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:45.871285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:45.871715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:45.998287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:46.008325 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bd884371-7fd2-4367-8bc6-00bb81019c81 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.148106 Oct 28 15:18:46.009021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 114/198] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:45 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:46.623402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:46.623402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:46.627184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:46.627656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:46.629056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:46.629485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:46.763325 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-91cb2900-6991-494e-82f1-29913f54a328 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 14 microversion: 2.20 time: 0.148095 Oct 28 15:18:46.763960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 85/199] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:46 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:47.027055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:47.027658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:47.035258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:47.035755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:47.036605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:47.037036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:47.157759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:47.166702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a13cb407-31cb-44af-94a0-fbda7bbab67e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.142610 Oct 28 15:18:47.166702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 115/200] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:47 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:47.777123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:47.778517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:47.785549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:47.786141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:47.787015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:47.787558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:48.182443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:48.183040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:48.189244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:48.189763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:48.191088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:48.191521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:48.322187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:48.332919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f2ffa6db-e7c9-4fcb-9685-b335a26b2d6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.153963 Oct 28 15:18:48.333557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 116/201] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:48 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:49.349565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:49.350328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:49.356257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:49.356737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:49.358112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:49.358545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:49.551073 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:49.559120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6e0216cc-f755-4874-9c60-4fb0e83727bd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.213178 Oct 28 15:18:49.559968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 117/202] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:49 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:50.577148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:50.578381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:50.596180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:50.596180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:50.596180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:50.596180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:50.765643 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:50.772807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fdbe220f-e6f0-4a9d-9368-6c7f7300de68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.199728 Oct 28 15:18:50.773363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 118/203] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:50 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:51.082296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:51.082829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:51.088494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.088936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.089694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.090121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.114627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:18:51.493993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0026dfb8-8b9f-44ad-abfb-d33835c240c7 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 204 len: 0 microversion: 2.1 time: 0.415487 Oct 28 15:18:51.494496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 119/204] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:18:51 2021] DELETE /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 15:18:51.503522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:51.504199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:51.510482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.511001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.511757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.512521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.631468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:51.639794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0f4d3eef-aab0-46e3-8f7b-0f7194025464 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.140720 Oct 28 15:18:51.640609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 120/205] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:51 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:51.789474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:51.790397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:51.796215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.796969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.797986 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:51.798623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:51.969754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:51.980060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-892bc087-c1bc-4d14-82c9-caefd4e0a754 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.192551 Oct 28 15:18:51.980976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 121/206] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:51 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:52.631281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dc66e954-379d-4086-a550-c0c442470f86 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 15895 microversion: 2.20 time: 4.860398 Oct 28 15:18:52.632081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 86/207] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:47 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 15895 bytes in 4862 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:18:52.657264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:52.658562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:52.665624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:52.666065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:52.666825 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:52.667241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:52.805593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:52.813405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5a1dcc78-e94f-4b71-9bf9-1474469263c3 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.159734 Oct 28 15:18:52.814191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 122/208] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:52 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:53.002380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:53.003124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:53.010758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.011206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.011986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.012435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.132005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:53.142988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cff47a08-3361-4370-90ed-a42f3d8cf0db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.144550 Oct 28 15:18:53.143562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 87/209] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:52 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:53.642466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:53.643415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:53.649029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.649556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.650198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.650612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.814369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-83c06a24-bd99-47c2-9291-3ec54e3d90cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 17602 microversion: 2.20 time: 0.175355 Oct 28 15:18:53.818228 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 123/210] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:53 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 17602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:18:53.847136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:53.847878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:53.854401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.855078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.855941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:53.856493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:53.980709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:53.988368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3586328f-a280-4b25-b5e0-43351074bb31 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.145859 Oct 28 15:18:53.988948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 88/211] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:53 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:54.162334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:54.163039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:54.172129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:54.172861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:54.173541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:54.174157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:54.353421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:54.362361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-70e05b37-fbf6-4f82-a80b-4b8fc7182c17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.206733 Oct 28 15:18:54.362963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 124/212] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:54 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:54.825557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:54.832336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:54.835403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:54.835903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:54.836761 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:54.837271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:54.933493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-deab84b5-6ad7-4ff4-9d79-913e2819028e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 17602 microversion: 2.20 time: 0.111475 Oct 28 15:18:54.941957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 89/213] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:54 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 17602 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:18:55.006998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:55.007600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:55.013750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.014193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:55.014953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.015372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:55.140708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:55.148590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2bc4a4f6-86a4-4553-bc07-95ae48740322 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.147953 Oct 28 15:18:55.149143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 125/214] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:54 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:55.379879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:55.380726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:55.388100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.388565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:55.389334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.389754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:55.521029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:55.529385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ae097d0d-f1bf-4b3f-8d38-f21d5f976ee2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.153865 Oct 28 15:18:55.530039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 90/215] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:55 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:55.949619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:18:55.950563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:55.956764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.957215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:55.957976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:55.958405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:56.166501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:56.167248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:56.178952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:56.178952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:56.178952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:56.178952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:56.295755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:56.303706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-38f62ffd-89a5-4122-ad9d-bd0f0c314a4d tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.141464 Oct 28 15:18:56.304302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 91/216] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:56 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:56.546743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:56.547362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:56.554315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:56.554746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:56.555538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:56.555962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:56.704365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:56.711827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-731dea43-9897-452c-bdf7-66949442e1d0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.169529 Oct 28 15:18:56.712412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 92/217] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:56 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:18:57.320607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:57.321188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:57.327363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:57.327800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:57.328586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:57.329022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:57.463261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:57.472052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-54f4e6c0-2968-4d66-9fea-f942f1cb0c09 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.154612 Oct 28 15:18:57.472739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 93/218] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:57 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:57.728347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:57.729112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:57.735718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:57.735718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:57.735964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:57.736602 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:57.855139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:57.862801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-488ef4b5-a616-4260-944a-a68a3e67a376 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.137612 Oct 28 15:18:57.863358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 94/219] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:57 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:58.488808 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:58.489399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:58.495049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:58.495489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:58.496238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:58.496691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:58.612541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:58.620200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-85c909d7-6d7d-40ba-baf3-1a07f1d596d4 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.135036 Oct 28 15:18:58.620789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 95/220] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:58 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:58.879246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:58.879781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:58.886251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:58.886692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:58.887444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:58.887870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:59.007155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:59.014607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-07856a91-3a8b-48ef-82b1-ee29053e857d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.139555 Oct 28 15:18:59.015168 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 96/221] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:58 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:18:59.156658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8ebe94d4-46aa-46eb-a40a-d09b0b192448 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 21790 microversion: 2.20 time: 3.210467 Oct 28 15:18:59.157224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 126/222] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:18:55 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 21790 bytes in 3212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:18:59.637002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:18:59.637629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:18:59.643324 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:59.643773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:59.644534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:18:59.644958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:18:59.763770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:18:59.771798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1babb1e7-1907-4d94-acc3-8558aab2a18b tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.138637 Oct 28 15:18:59.772355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 97/223] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:18:59 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:00.031303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:00.031891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:00.039165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.039598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.040344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.040796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.157754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:00.165690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ddf81c3a-c8b1-4d97-8a9a-f696d31401d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.138414 Oct 28 15:19:00.166243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 127/224] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:00 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:00.167932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:00.168897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:00.175194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.175636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.176409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.177166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.788794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:00.789421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:00.795590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.796029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.796867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:00.797295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:00.927804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:00.935439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c68a1260-6679-47ca-8e72-1c95b322e72e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.150359 Oct 28 15:19:00.935993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 128/225] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:00 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:01.181693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8ca1ed1a-0fa4-4039-9b11-b70caf873263 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 24946 microversion: 2.20 time: 1.017236 Oct 28 15:19:01.182227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:01.182705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 98/226] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:00 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 24946 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:01.183012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:01.189237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:01.189676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:01.190437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:01.190864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:01.315412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:01.322939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-986e990e-30ea-42f4-8528-de3fb6529c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.144429 Oct 28 15:19:01.323483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 129/227] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:01 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:01.953564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:01.954237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:01.961493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:01.961929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:01.962672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:01.963092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:02.084276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:02.092030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-210bd36f-97a1-4fee-a695-7e04bc186e67 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.142374 Oct 28 15:19:02.092621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 99/228] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:01 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:02.193691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:02.194582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:02.200960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:02.201396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:02.202143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:02.202561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:02.356566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:02.356566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:02.356566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:02.356566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:02.357581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:02.357581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:02.473483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9fc7ef9e-691c-4bf9-8362-66b22afcfefb tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 25721 microversion: 2.20 time: 0.283534 Oct 28 15:19:02.474456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 130/229] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:02 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 25721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:02.475942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:02.483447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a5d501de-ffbd-4e5b-87d2-60ddc6602edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.147717 Oct 28 15:19:02.484030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 100/230] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:02 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:03.109352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:03.110062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:03.116740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.117186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.117942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.118380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.247703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:03.256131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5ef9c79b-d32f-42b7-b9a6-ff938b4801fc tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1552 microversion: 2.1 time: 0.150753 Oct 28 15:19:03.256758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 131/231] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:03 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:03.451780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-711bec28-df9b-4807-b73b-28e66e84a00c req-bc723dc3-764b-41d7-b5c6-81e9c6d5b6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84969cc-4f86-4c5d-ab37-08473a79a268", "name": "network-vif-deleted", "tag": "16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:03.453980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:19:03.453980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:19:03.461504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-711bec28-df9b-4807-b73b-28e66e84a00c req-bc723dc3-764b-41d7-b5c6-81e9c6d5b6df service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.461931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-711bec28-df9b-4807-b73b-28e66e84a00c req-bc723dc3-764b-41d7-b5c6-81e9c6d5b6df service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.472823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-711bec28-df9b-4807-b73b-28e66e84a00c req-bc723dc3-764b-41d7-b5c6-81e9c6d5b6df service nova] Creating event network-vif-deleted:16dd4ec9-009f-42fc-94d8-3fa3b8d3ac3c for instance a84969cc-4f86-4c5d-ab37-08473a79a268 on hv-cinder-78364 Oct 28 15:19:03.477689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-711bec28-df9b-4807-b73b-28e66e84a00c req-bc723dc3-764b-41d7-b5c6-81e9c6d5b6df service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Oct 28 15:19:03.478328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 101/232] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:19:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:19:03.484809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:03.496446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:03.496446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.496446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.496446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.497009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.501348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:03.502040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:03.511013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.511467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.512234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:03.512685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:03.647228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:03.654426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-849467ed-3bb6-4a6c-b6e6-3b66ff9257cd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.157068 Oct 28 15:19:03.654982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 102/233] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:03 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:03.659458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ecc7aefb-b926-41d9-9d63-afae707755a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 26369 microversion: 2.20 time: 0.178387 Oct 28 15:19:03.660145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 132/234] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:03 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 26369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:04.057276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1336732363", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "0ebebb8e-e9b3-4c5a-a83f-e9112f5d49c3"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:04.114482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] validate_networks() for [('0ebebb8e-e9b3-4c5a-a83f-e9112f5d49c3', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:19:04.275398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:04.280001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:04.284275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.284854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.285642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.286074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.546613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca9efe319004e748091a770c32c1ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556fc8a6a9084bbcac95337efe7e0c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:04.557776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cafeffa8-e1fd-4bfc-8098-8adc3e93b4d5 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 200 len: 1345 microversion: 2.1 time: 0.286503 Oct 28 15:19:04.560430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 133/235] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:04 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 1345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:04.671282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:19:04.671842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:04.672072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:19:04.672226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:04.672937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:19:04.674216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:19:04.675507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:19:04.682913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.683372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.684123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.684583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.688912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.689422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.690332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.690820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.706607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Getting quotas for project a4edc71432e54043b1d565e37a39506c. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:19:04.710385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Getting quotas for user 62e913a28e9c4564bc6cabef414c25c1 and project a4edc71432e54043b1d565e37a39506c. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:19:04.720661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:19:04.723465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:19:04.794783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-291431ba-fb12-4505-8d82-2313d72b62a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 26834 microversion: 2.20 time: 0.127115 Oct 28 15:19:04.795440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 134/236] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:04 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 26834 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:04.800872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:04.801547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:04.808009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.814031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.814031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:04.814031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:04.879700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1a6b10b3-9526-433e-8dcc-82fd793f79e0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826093 Oct 28 15:19:04.880350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 103/237] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:19:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:19:04.890715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-de2a53f2-f507-442b-9ade-43167c713177 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:04.895457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-de2a53f2-f507-442b-9ade-43167c713177 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:04.967892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-de2a53f2-f507-442b-9ade-43167c713177 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:04.975656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-de2a53f2-f507-442b-9ade-43167c713177 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1219 microversion: 2.1 time: 0.088764 Oct 28 15:19:04.976328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:04.976507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 104/238] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:04 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:04.984672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-731a2470-bb77-4a1d-9a77-88fc42d26e23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.187826 Oct 28 15:19:04.996987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 135/239] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:04 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:05.575332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:05.575998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:05.583481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.583940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.584867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.585418 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.599473 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] HTTP exception thrown: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. Oct 28 15:19:05.600063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Returning 404 to user: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:19:05.600980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8d36f293-1e24-41bf-83fa-609f95bdc9fa tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 404 len: 111 microversion: 2.1 time: 0.029584 Oct 28 15:19:05.601528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 105/240] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:05 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 15:19:05.714886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:05.715908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:05.722236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.722785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.723555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.723984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.806878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:05.807981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:05.814671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.820452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.820452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:05.820452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:05.886197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] HTTP exception thrown: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. Oct 28 15:19:05.886794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Returning 404 to user: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:19:05.887623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-48e3eb80-0bd2-4ba2-82b0-49e583cbb2bb tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.176666 Oct 28 15:19:05.888195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 136/241] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:19:05 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268/os-volume_attachments => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:19:05.931995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-338a45d0-bfa1-41ae-a6a0-99b5babb9387 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 27215 microversion: 2.20 time: 0.128683 Oct 28 15:19:05.936378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 106/242] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:05 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 27215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:19:05.992959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-92bb7b3d-7765-491f-a3f8-e6a9be2a9f85 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:05.993617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-92bb7b3d-7765-491f-a3f8-e6a9be2a9f85 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:06.006988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:06.009404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:06.016792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:06.017334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:06.018140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:06.019175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:06.047079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-92bb7b3d-7765-491f-a3f8-e6a9be2a9f85 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:06.054311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-92bb7b3d-7765-491f-a3f8-e6a9be2a9f85 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1219 microversion: 2.1 time: 0.065094 Oct 28 15:19:06.063788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 137/243] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:06.145170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:06.155532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-48eb7a5e-8714-4fb5-a54a-1acceb3c4c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.154279 Oct 28 15:19:06.156110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 107/244] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:05 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:06.945365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:06.946353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:06.955313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:06.956055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:06.957481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:06.957917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.071939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:07.072587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:07.078790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.079231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.080011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.080560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.108932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8d572e62-b4cd-44bc-9220-79cda3303e3a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 27554 microversion: 2.20 time: 0.168277 Oct 28 15:19:07.113959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 138/245] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:06 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 27554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:07.157504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:07.164966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d1ed5609-f912-4099-9436-ee3bfb5c7178 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1271 microversion: 2.1 time: 0.096720 Oct 28 15:19:07.165538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 108/246] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:07.173308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:07.174026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:07.181265 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.181705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.182472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.182895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.287816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:07.289334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:07.301028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.301799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.302871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.303576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.323435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] HTTP exception thrown: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. Oct 28 15:19:07.323435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Returning 404 to user: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:19:07.323435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a8534adb-aa3e-46e8-a48b-16bb576c6342 tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 404 len: 111 microversion: 2.1 time: 0.038246 Oct 28 15:19:07.323435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 109/247] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:19:07 2021] DELETE /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 15:19:07.330451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:07.331062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] [instance: a84969cc-4f86-4c5d-ab37-08473a79a268] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:07.331740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:07.338643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.339052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.339900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:07.340252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:07.342631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d472cb55-9412-4d12-9353-1e4704ac313f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.173171 Oct 28 15:19:07.343676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 139/248] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:07 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:07.364375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] HTTP exception thrown: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. Oct 28 15:19:07.365185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] Returning 404 to user: Instance a84969cc-4f86-4c5d-ab37-08473a79a268 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:19:07.366501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b2a66e7d-9b14-4027-bbde-93d108b4e56e tempest-DeleteServersTestJSON-1149045525 tempest-DeleteServersTestJSON-1149045525-project] 10.222.0.86 "GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268" status: 404 len: 111 microversion: 2.1 time: 0.039220 Oct 28 15:19:07.367144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 110/249] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:07 2021] GET /compute/v2.1/servers/a84969cc-4f86-4c5d-ab37-08473a79a268 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 15:19:08.123907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:08.124865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:08.130743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.131185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.131938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.132365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.182152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:08.182749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:08.188952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.189415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.190177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.190583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.288705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a1d35854-287f-47ed-84db-34a5bcf4c4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 27687 microversion: 2.20 time: 0.170579 Oct 28 15:19:08.290000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 140/250] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:08 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 27687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:08.318904 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:08.329982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bbb4f8a4-f5e2-4c70-8eaa-011e103e9d18 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1289 microversion: 2.1 time: 0.151406 Oct 28 15:19:08.333365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 111/251] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:08 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:08.382187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:08.382187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:08.382187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.382187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.392157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:08.394076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:08.549526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:08.557203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b63868c8-7999-44b9-948e-865c28dcdea6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.192243 Oct 28 15:19:08.557861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 141/252] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:08 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:09.304333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:09.305541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:09.315023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.315023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.315560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.316512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.352189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:09.352945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:09.359453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.360000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.360915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.361445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.426594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4eacc97f-0df7-4894-a609-6535143b9809 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 27872 microversion: 2.20 time: 0.129868 Oct 28 15:19:09.427865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 112/253] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:09 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 27872 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:09.501309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:09.508726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6dbb905e-3047-41fb-8838-88c34fb469a2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.160124 Oct 28 15:19:09.509923 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 142/254] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:09.575013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:09.575518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:09.583539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.584524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.585495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:09.586147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:09.731260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:09.755746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7c027e18-867a-4133-95f1-391064411598 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.184727 Oct 28 15:19:09.756434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 113/255] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:09 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:10.094233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-6c10d920-7677-471c-8f8e-9a85deb3f5ae req-0e069d15-ffe4-43ce-894f-82a5f4cd7777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f8d0b6-a6f5-4768-8039-c0e7cd03aa86", "tag": "14ee62a7-daaf-4e0d-93c6-8df9ecaae09d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:10.095772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:19:10.095772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:19:10.110327 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c10d920-7677-471c-8f8e-9a85deb3f5ae req-0e069d15-ffe4-43ce-894f-82a5f4cd7777 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.110973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c10d920-7677-471c-8f8e-9a85deb3f5ae req-0e069d15-ffe4-43ce-894f-82a5f4cd7777 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.126752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-6c10d920-7677-471c-8f8e-9a85deb3f5ae req-0e069d15-ffe4-43ce-894f-82a5f4cd7777 service nova] Creating event network-changed:14ee62a7-daaf-4e0d-93c6-8df9ecaae09d for instance 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 on hv-cinder-78364 Oct 28 15:19:10.132319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-6c10d920-7677-471c-8f8e-9a85deb3f5ae req-0e069d15-ffe4-43ce-894f-82a5f4cd7777 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041843 Oct 28 15:19:10.133112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 143/256] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:19:10.437812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:10.439334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:10.446222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.446872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.447791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.448365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.529339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:10.530169 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:10.537752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.538336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.539561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.540101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.577329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-265e8ee0-e649-4f3e-82f5-0654d404a0f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28107 microversion: 2.20 time: 0.143002 Oct 28 15:19:10.581246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 114/257] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:10 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28107 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:10.682970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:10.695568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-49cde4f2-9815-40b4-8d23-834f17466e28 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.172076 Oct 28 15:19:10.696209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 144/258] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:10.774457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:10.775388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:10.782582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.783295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.784323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:10.784846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:10.940872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:10.953360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ae1dd84e-cc9e-4b6b-abd8-126e3644f5d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.183785 Oct 28 15:19:10.954314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 115/259] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:10 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:11.588888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:11.589798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:11.595951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.596319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:11.597139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.598076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:11.715814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:11.716558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:11.723995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.724467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:11.725251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.725671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:11.859207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:11.866428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-affa161f-d7ca-4056-acdd-31164fc301ae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.154249 Oct 28 15:19:11.866972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 116/260] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:11.976423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:11.977021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:11.983063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.983414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:11.984151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:11.984598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:12.127600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:12.137058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd88df46-bf5d-4b4a-b63b-1991e6b1a39b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.164983 Oct 28 15:19:12.137854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 117/261] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:11 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:12.882674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:12.883298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:12.889558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:12.889995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:12.890744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:12.891167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:13.025222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:13.032371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6b739a9e-b62f-4c72-9492-0071f3e7f431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.153294 Oct 28 15:19:13.032956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 118/262] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:13.154187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:13.154832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:13.161233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:13.161672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:13.162424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:13.162842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:13.300148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:13.307920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e0c8fbe0-d1a9-4e05-aaea-c83f2e947f20 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.157297 Oct 28 15:19:13.308500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 119/263] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:13 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:14.048227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:14.048852 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:14.055772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:14.056213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:14.057005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:14.057511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:14.220508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:14.228731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-36bca9f1-df83-4402-9752-82963435881c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.183962 Oct 28 15:19:14.229671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 120/264] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:14.324036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:14.329023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:14.330435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:14.330880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:14.331644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:14.332071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:14.452835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:14.460802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-22ce871d-0513-43e8-b562-b52e1538a730 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.140701 Oct 28 15:19:14.461377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 121/265] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:14 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:15.245845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:15.246443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:15.252770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:15.253221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:15.254094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:15.254523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:15.376711 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:15.383986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8975ebe8-8633-4bcc-8f05-e643e8cb6f8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.141809 Oct 28 15:19:15.384835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 122/266] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:15 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:15.477690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:15.478337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:15.484184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:15.484679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:15.485438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:15.485857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:15.612090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:15.619250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eeb7f135-1f9c-4fe8-861e-8136f965c664 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.145103 Oct 28 15:19:15.619802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 123/267] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:15 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:16.400643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:16.401251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:16.407393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:16.407835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:16.408709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:16.409138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:16.531245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:16.540245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-755d2ec8-252e-40a5-8451-acef71e0fef7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.142973 Oct 28 15:19:16.541356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 124/268] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:16.635680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:16.636199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:16.642087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:16.642525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:16.643277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:16.643704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:16.766281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:16.773625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-136d9585-f403-4178-abff-81ccc0241577 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.141995 Oct 28 15:19:16.774176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 125/269] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:16 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:17.072283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fd5328e2-a47c-45a7-973f-5dc11d414e0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 5.486854 Oct 28 15:19:17.073195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 145/270] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:11 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 5489 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:17.557366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:17.557366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:17.563871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:17.564304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:17.565095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:17.565520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:17.690344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:17.697792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4266ba4a-3c2c-4c85-97a3-916c98b8eb32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.144694 Oct 28 15:19:17.698459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 126/271] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:17.791489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:17.792182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:17.799732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:17.800163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:17.800928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:17.801352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:17.921588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:17.932754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-be746480-be4a-4eac-80b7-ceecf034d841 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.141420 Oct 28 15:19:17.932754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 146/272] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:17 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:18.084918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:18.085823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:18.091687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.099679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:18.099679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.099679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:18.194038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-63365625-dd15-4387-8351-fe4f8a816d21 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.111831 Oct 28 15:19:18.194038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 127/273] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:18 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:18.715494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:18.716166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:18.722662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.723252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:18.724049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.724512 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:18.851226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:18.859887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-012950d0-1233-47b3-8406-39ea95572cf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.148248 Oct 28 15:19:18.860482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 147/274] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:18.946569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:18.948540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:18.963912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.963912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:18.963912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:18.963912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:19.116828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:19.124128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-33bc9240-0d9c-42df-b80d-a6d418dcd30c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.181653 Oct 28 15:19:19.125095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 128/275] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:18 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:19.203867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:19.204836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:19.211407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:19.211842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:19.212617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:19.213042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:19.298931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a12ccbee-7777-4d5a-b51f-fc24dd61d92a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.098495 Oct 28 15:19:19.299828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 148/276] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:19 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:19.879869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:19.880998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:19.889460 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:19.889898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:19.890675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:19.891095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:20.018930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:20.027253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-30d11439-4731-4184-8ea9-f0402eeae13b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.153318 Oct 28 15:19:20.028078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 129/277] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:20.142287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:20.143050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:20.150276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:20.150918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:20.151686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:20.152133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:20.274596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:20.281808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d2fa6ad-bac5-4350-81bd-50c5b236f0e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.143632 Oct 28 15:19:20.282357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 149/278] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:20 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:20.310575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:20.311497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:20.318386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:20.318828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:20.319591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:20.320015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:20.401537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-46d3a4f0-b78b-4dc6-9608-f45820559866 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.094479 Oct 28 15:19:20.402426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 130/279] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:20 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:21.043723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:21.044462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:21.051930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.052427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.053231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.053661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.225178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:21.232556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-113879cc-1285-462d-9d48-08287880c456 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.192610 Oct 28 15:19:21.233125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 150/280] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:21.299449 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:21.300136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:21.307845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.308284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.311958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.311958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.413071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:21.414040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:21.420615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.421066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.421887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:21.422319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:21.476464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:21.484071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6df3c139-c1af-427e-ac64-78a0c210b6c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.188695 Oct 28 15:19:21.484881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 131/281] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:21 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:22.247998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:22.248543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:22.254705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:22.255141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:22.255891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:22.256311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:22.378498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:22.386008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-38624335-32cf-43aa-ac9a-a0b9f756c7c4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.141616 Oct 28 15:19:22.386740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 132/282] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:22.502366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:22.504724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:22.512509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:22.513027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:22.513872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:22.514384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:22.658294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:22.667000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-004c206e-3afd-4da0-9e74-59145e7a1f78 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.168733 Oct 28 15:19:22.677260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 133/283] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:22 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:23.402430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:23.403036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:23.409151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:23.409593 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:23.410387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:23.410812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:23.531702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:23.538895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cfb2e822-f852-4abc-8f53-7439e4cf3e91 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.140093 Oct 28 15:19:23.539458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 134/284] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:23 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:23.683092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:23.683769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:23.689805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:23.691985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:23.692906 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:23.693340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:23.833964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:23.841199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3c95672f-bbf0-4081-9b93-cc9932a4a87f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.161743 Oct 28 15:19:23.849220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 135/285] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:23 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:24.554828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:24.555511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:24.561596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:24.562035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:24.562788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:24.563213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:24.690409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:24.697912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2bd3916c-0f08-44f2-86e2-fd2b528e8488 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.146809 Oct 28 15:19:24.702282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 136/286] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:24.863847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:24.864706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:24.870486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:24.871001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:24.871830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:24.872337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:25.000544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:25.008326 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c43737a0-7e60-4305-a3be-acebf43a887c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.148114 Oct 28 15:19:25.008914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 137/287] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:24 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:25.717149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:25.717886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:25.724731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:25.725170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:25.725919 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:25.726330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:25.853893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:25.861947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-de5b6eb1-bbbd-4250-a231-d660edf68fb3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.147986 Oct 28 15:19:25.862584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 138/288] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:25.919054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1b03ba11-d396-44e6-8bde-6f0a3dca452b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 4.509846 Oct 28 15:19:25.922387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 151/289] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:21 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 4512 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:19:26.026596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:26.027202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:26.033002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.033445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:26.034404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.034839 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:26.169256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:26.176633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6c332fc9-ad60-4671-9842-24efb2d71874 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.153729 Oct 28 15:19:26.177288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 139/290] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:26 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:26.878822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:26.879513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:26.887159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.887632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:26.888413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.888845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:26.930953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:26.931856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:26.938323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.938770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:26.939529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:26.939948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:27.025699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:27.033129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6a6b66e8-c0bd-44c5-a474-0a367ba75c80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.158239 Oct 28 15:19:27.033677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 152/291] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:26 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:27.189829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4a949f97-f3bc-4a44-b299-ead67453d36c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.262768 Oct 28 15:19:27.191129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 140/292] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:26 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:19:27.193378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:27.193984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:27.200250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:27.200729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:27.201493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:27.201950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:27.319846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:27.327047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-812d8428-e8e5-4377-955e-10df4583fbbc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.137391 Oct 28 15:19:27.327606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 153/293] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:27 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:28.050454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:28.051140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:28.058069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.058513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.059269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.059695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.180328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:28.188340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7d0e1354-cd12-4a19-b059-bb1b8ee5a357 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.141746 Oct 28 15:19:28.189049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 141/294] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:28.201979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:28.202880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:28.209050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.209493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.210243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.210669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.337053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-741efc8f-be1a-4e9e-ac03-3f2a8e560782 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.138310 Oct 28 15:19:28.337997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 154/295] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:28 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:28.343430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:28.344174 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:28.350883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.351329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.352101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:28.352569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:28.472594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:28.480236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5faf7635-51ea-41c6-9e42-b4a450897fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.140939 Oct 28 15:19:28.480828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 142/296] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:28 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:29.207453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:29.208709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:29.215620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.216068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.216877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.217308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.359867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:29.364479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:29.366493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:29.367646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a97ded3e-803d-465f-8ad8-a18f42802f4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.164295 Oct 28 15:19:29.372420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 155/297] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:29.373154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.373666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.374496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.375123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.497479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:29.498075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:29.504144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.504618 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.505874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:29.506289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:29.612748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-89b54a62-4ad4-4221-8f2d-3e74cd0c7440 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.267155 Oct 28 15:19:29.613401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 143/298] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:29 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:29.631918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:29.639403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b19dd2a6-7d0a-4994-9cfe-aac7e8ff2266 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.145526 Oct 28 15:19:29.639950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 156/299] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:29 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:30.296444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-a45da099-486f-411f-8ac2-7a3131c90b41 req-8b299952-8d6c-4d65-b455-15590f034d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f8d0b6-a6f5-4768-8039-c0e7cd03aa86", "name": "network-vif-plugged", "status": "completed", "tag": "14ee62a7-daaf-4e0d-93c6-8df9ecaae09d"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:30.298180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:19:30.298180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:19:30.306131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-a45da099-486f-411f-8ac2-7a3131c90b41 req-8b299952-8d6c-4d65-b455-15590f034d1f service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.306628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-a45da099-486f-411f-8ac2-7a3131c90b41 req-8b299952-8d6c-4d65-b455-15590f034d1f service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.319439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-a45da099-486f-411f-8ac2-7a3131c90b41 req-8b299952-8d6c-4d65-b455-15590f034d1f service nova] Creating event network-vif-plugged:14ee62a7-daaf-4e0d-93c6-8df9ecaae09d for instance 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 on hv-cinder-78364 Oct 28 15:19:30.324323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-a45da099-486f-411f-8ac2-7a3131c90b41 req-8b299952-8d6c-4d65-b455-15590f034d1f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Oct 28 15:19:30.324991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 144/300] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:19:30.383804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:30.384425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:30.390959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.391381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.392122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.392576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.529942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:30.538205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5e3428d2-8162-4979-9e85-c28f4c61ed87 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.158434 Oct 28 15:19:30.538793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 157/301] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:30.633937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:30.635207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:30.641853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.642263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.643051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.643475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.694853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:30.697019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:30.702019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.702457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.703225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:30.703696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:30.724752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-67b72ea9-a98c-43bb-994e-ef8facef4323 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.101886 Oct 28 15:19:30.725398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 145/302] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:30 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:30.835840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:30.844224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bfb36b04-9503-4b4b-a1eb-78e89cdc3825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.153522 Oct 28 15:19:30.844896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 158/303] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:30 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:31.555889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:31.556614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:31.563457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.563898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.564707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.565137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.687752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:31.695319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ea15ab0b-b477-4030-b7f8-f55c186d7e95 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.143920 Oct 28 15:19:31.695885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 146/304] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:31.736676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:31.737600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:31.751994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.751994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.751994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.751994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.861426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:31.862026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:31.868925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.869383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.872229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:31.872229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:31.906698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2dfce3ec-d69a-4fb2-80ae-4281e947a3d3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.173594 Oct 28 15:19:31.909715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 159/305] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:31 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:31.990372 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:31.997965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-71f0ea8e-c593-44df-b9c9-accff8964b3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1520 microversion: 2.1 time: 0.140202 Oct 28 15:19:31.998515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 147/306] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:31 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:32.713234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:32.713864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:32.720594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:32.721027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:32.721777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:32.722214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:32.845315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:32.854967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d38689e8-a5d2-46ae-bad8-93d3ee68be2d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1319 microversion: 2.1 time: 0.145798 Oct 28 15:19:32.855534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 160/307] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:32.918012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:32.919147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:32.925518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:32.925961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:32.926780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:32.927220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.014988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:33.015502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:33.016879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-36394029-d7b5-4366-bd88-ff2dd5976f71 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.102437 Oct 28 15:19:33.018515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 148/308] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:32 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:33.022729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.023197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.023960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.024376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.148948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:33.156117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dfe39d16-d22b-4613-9d12-46f9edcf03b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1500 microversion: 2.1 time: 0.145103 Oct 28 15:19:33.160419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 161/309] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:33 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1500 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:33.172543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:33.173230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:33.179896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.180335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.181105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.181528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.316250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:33.323958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-da84405f-aa1b-472b-8070-476c9f02fef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1514 microversion: 2.1 time: 0.155563 Oct 28 15:19:33.324531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 149/310] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:33.871388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:33.872143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:33.878466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.878912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:33.879683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:33.880119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:34.011494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:34.017945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-96ade47c-eb56-439c-88b1-09231ab6c2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1507 microversion: 2.1 time: 0.150274 Oct 28 15:19:34.018660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 162/311] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:34.033194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:34.034186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:34.044089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:34.044562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:34.045329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:34.045754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:34.132832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d333fcf2-c8ba-4f9f-a492-a113d49dd56d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.105457 Oct 28 15:19:34.132832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 150/312] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:34 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:35.144367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:35.146200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:35.152917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:35.158813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:35.158813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:35.158813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:35.239896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-18fdd5be-18d4-410e-a180-6957ef10328a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.099810 Oct 28 15:19:35.240564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 163/313] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:35 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:19:36.212350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:36.213406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:36.220240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.220705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.221528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.221889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.249695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lazy-loading 'flavor' on Instance uuid 13279aaf-dc79-4544-b2dc-8c5099d7b405 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:19:36.252184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:36.253310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:36.264231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.264960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.271909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.271909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.396936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-684461d1-e532-45af-81d4-6f2da69049a0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.148938 Oct 28 15:19:36.402242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 164/314] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:36 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:36.765156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-96f645e2-7a13-4d0a-9149-7cc354b21949 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action" status: 200 len: 32 microversion: 2.1 time: 0.557803 Oct 28 15:19:36.765755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 151/315] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:19:36 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action => generated 32 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:19:36.776311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:36.776895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:36.783978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.786985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.786985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:36.786985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:36.917117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:36.924791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0fd28c97-3c3f-46cb-9f3c-4f3fbfabac99 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.153013 Oct 28 15:19:36.925765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 165/316] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:37.410246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:37.413447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:37.422731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:37.423520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:37.424562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:37.425201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:37.510440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fbd864ef-75c0-4a81-8489-77cc43a490a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.104847 Oct 28 15:19:37.511742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 152/317] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:37 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:37.942766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:37.944747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:37.952517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:37.952988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:37.953827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:37.954401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:38.118352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:38.130136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-59e523d0-0908-4761-a169-7ee25f8f5cac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.191019 Oct 28 15:19:38.140641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 166/318] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:38.527119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:38.527119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:38.531989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:38.532476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:38.533660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:38.534269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:38.632551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e7a52db8-0cd0-4b63-b2c8-07c0a8a1fd8f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.113561 Oct 28 15:19:38.633610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 153/319] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:38 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:39.146901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:39.147511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:39.153859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:39.154301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:39.155319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:39.155758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:39.347240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:39.356155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c8747d5e-3bae-4165-af41-1fcd03209825 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.212936 Oct 28 15:19:39.367147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 167/320] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:39.644296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:39.646071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:39.655601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:39.655601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:39.655911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:39.656576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:39.747636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c95a93fb-dee4-4023-9bc2-583fb52f3a27 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.107280 Oct 28 15:19:39.748893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 154/321] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:39 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:40.374391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:40.374991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:40.381707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:40.382152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:40.382896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:40.383319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:40.729151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:40.736636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6056e4c1-0de9-4e68-b7ec-f5349aa2fefe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.365858 Oct 28 15:19:40.737911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 168/322] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:40.759743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:40.761049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:40.768589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:40.768589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:40.769111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:40.769537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:40.856034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2eea3cb7-0e2a-4615-bd6a-c4a3d1f5a122 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.100301 Oct 28 15:19:40.859137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 155/323] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:40 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:41.757158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:41.761566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:41.767046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:41.767588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:41.768577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:41.769116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:41.869102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:41.870706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:41.877946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:41.878432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:41.879381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:41.880637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:41.936571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:41.944380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a142b445-1372-414c-91a2-2c05c68d7a34 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.191774 Oct 28 15:19:41.945131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 169/324] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:42.004305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-65ba00c2-86f5-4227-9fd2-9be6dec0311a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.140158 Oct 28 15:19:42.005779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 156/325] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:41 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:19:42.961754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:42.962350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:42.971053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:42.971801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:42.973258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:42.974146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:43.028184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:43.033434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:43.041620 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:43.042796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:43.044366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:43.044965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:43.130549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:43.138279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-966b5dda-14e7-444c-a1de-2e9c1bac94ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.180725 Oct 28 15:19:43.155714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 170/326] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:43.156243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e7a9766f-0267-41aa-864e-693af4942f31 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.130987 Oct 28 15:19:43.156243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 157/327] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:43 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:44.166128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:44.167284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:44.172631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:44.174051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:44.178068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:44.178549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:44.179390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:44.179811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:44.183328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:44.184052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:44.184963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:44.185465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:44.297181 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7c8a5f0e-858f-42e8-98b1-12e91905b4ae tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.134653 Oct 28 15:19:44.301081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 171/328] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:44 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:44.324698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:44.334323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7438e8ed-47e1-4e6c-9c35-9400b169d57a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.163821 Oct 28 15:19:44.334323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 158/329] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:45.309419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:45.311213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:45.318503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:45.319138 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:45.319951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:45.320901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:45.350190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:45.351431 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:45.358680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:45.359447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:45.360751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:45.361304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:45.402661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a0139093-fa34-455f-a263-02a71259758e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.097511 Oct 28 15:19:45.403315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 172/330] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:45 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:45.548896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:45.557267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-73838c6a-31d7-478c-b991-3dce4fab6d67 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.211087 Oct 28 15:19:45.558190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 159/331] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:46.417411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:46.418649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:46.425669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:46.426110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:46.427025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:46.427465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:46.506674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-98704e08-bc34-4214-981b-94bfe9e3c579 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.095117 Oct 28 15:19:46.507716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 173/332] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:46 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:46.574236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:46.574834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:46.580777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:46.587220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:46.587220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:46.587220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:46.756437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:46.765240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37d5f0c0-ca07-4f85-a41f-efd009b13880 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.193561 Oct 28 15:19:46.765240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 160/333] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:47.519044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:47.520039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:47.527450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:47.527889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:47.528678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:47.529128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:47.611483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bbb95bf4-3fe8-4023-82e7-b9dd566a40ba tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.096365 Oct 28 15:19:47.612303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 174/334] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:47 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:47.780513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:47.781116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:47.787609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:47.788055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:47.788854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:47.789282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:47.967281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:47.975016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-030d15db-fbb0-4e71-aad6-8f2e742d6b1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.198197 Oct 28 15:19:47.975591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 161/335] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:48.623515 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:48.624534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:48.630962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:48.632185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:48.632185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:48.632607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:48.717544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-94348ac1-18f0-498d-bf36-7f93ec307a0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.097648 Oct 28 15:19:48.718157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 175/336] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:48 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:48.991005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:48.992009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:48.998380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:48.998930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:48.999782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:49.000217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:49.130929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:49.138286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-53eaa57a-a8f2-4909-966a-9f819bd99140 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.151097 Oct 28 15:19:49.138895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 162/337] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:49.730421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:49.731501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:49.738572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:49.739706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:49.740944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:49.741584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:49.842223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-30fb942c-743b-486a-868b-04c96a78a036 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.115693 Oct 28 15:19:49.842935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 176/338] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:49 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:50.155522 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:50.156063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:50.162670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:50.163103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:50.163875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:50.164297 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:50.285545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:50.293185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-01ffe9a1-6de1-491a-9ca2-356a852b9df7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.141390 Oct 28 15:19:50.293741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 163/339] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:50.854313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:50.855300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:50.861411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:50.861854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:50.862613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:50.863039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:50.978908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-967e87dc-929b-40a4-92eb-9f1caa647f6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 0.128494 Oct 28 15:19:50.979572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 177/340] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:50 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:51.309792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:51.310299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:51.316434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:51.316871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:51.317613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:51.318035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:51.434283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:51.441708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3da1c1ce-229c-442b-8316-0e53b8811272 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.135609 Oct 28 15:19:51.442260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 164/341] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:19:51.991218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:51.992211 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:51.998985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:51.999428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:52.000186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:52.000656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:52.458166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:52.458762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:52.464868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:52.465296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:52.466032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:52.466446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:52.583056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:52.590238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d60c2ba5-4c30-4ef0-a61d-78192937e9a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.135701 Oct 28 15:19:52.590963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 165/342] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:53.606265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:53.606907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:53.613227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:53.613670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:53.614432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:53.614865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:53.742194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:53.751011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9bf8b773-7dc4-48c5-b602-d810187f8e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.148309 Oct 28 15:19:53.751795 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 166/343] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:54.768946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:54.769560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:54.776743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:54.777187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:54.777950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:54.778376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:54.900592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:54.907659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6310737f-b185-4fd1-a6c2-20ef3a494a23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.142380 Oct 28 15:19:54.908214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 167/344] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:55.923284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:55.923878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:55.930544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:55.930977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:55.931732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:55.932154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:56.047406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:56.055082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ad7bd1cd-bccb-4304-a90e-81baa477c523 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.135382 Oct 28 15:19:56.055640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 168/345] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:57.072105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:57.072728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:57.078855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:57.079294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:57.080060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:57.080530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:57.200881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:57.208579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7cc7da4e-85d8-4d6a-95af-e1a05ad733f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.139626 Oct 28 15:19:57.209139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 169/346] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:58.225113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:58.225775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:58.231864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:58.232303 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:58.233078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:58.233503 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:58.302635 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-793df8e4-bb45-4315-acdd-9d47867e6a1b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28166 microversion: 2.20 time: 6.315376 Oct 28 15:19:58.303656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 178/347] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:51 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28166 bytes in 6317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:58.352061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:58.359236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-42a1b065-17ca-4bab-98c9-1f29ef8d44a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.137804 Oct 28 15:19:58.359781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 170/348] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:19:59.314974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:19:59.315880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:59.323271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:59.323717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:59.324511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:59.324943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:59.376137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:19:59.376767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:19:59.383399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:59.383844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:59.384696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:19:59.385124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:19:59.413770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e99991a1-b4e0-4f89-874a-c6fca778517d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28191 microversion: 2.20 time: 0.102720 Oct 28 15:19:59.417716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 179/349] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:19:59 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:19:59.507110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:19:59.516541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-231c32d6-9a62-4a65-8c50-ffdbe646b882 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.144078 Oct 28 15:19:59.517090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 171/350] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:19:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:00.425964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:00.427572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:00.434349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:00.435202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:00.435540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:00.435978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:00.533627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:00.534221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:00.537500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cd9fa655-6f2a-4d92-8270-111db0586e2d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28457 microversion: 2.20 time: 0.115474 Oct 28 15:20:00.539011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 180/351] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:00 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28457 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:00.541301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:00.541742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:00.542506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:00.542928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:00.665912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:00.673208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1a9c6665-4b6c-46b5-9a28-f8e41c16d401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.143185 Oct 28 15:20:00.673756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 172/352] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:01.549899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:01.550962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:01.558684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:01.559131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:01.559920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:01.560443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:01.649681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cf2245ae-f709-44fe-a10f-02af401b7b0f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28457 microversion: 2.20 time: 0.103606 Oct 28 15:20:01.650335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 181/353] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:01 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28457 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:01.688757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:01.689358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:01.695609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:01.696042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:01.696820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:01.697242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:01.819332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:01.826628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-03da1eb6-c930-4a8a-b5ef-3a630bb2f008 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.141429 Oct 28 15:20:01.827193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 173/354] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:02.662377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:02.663336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:02.670206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:02.670642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:02.671392 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:02.671817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:02.738775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3700c3db-c4dc-4aa5-8ec6-f552bc56fbaf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28457 microversion: 2.20 time: 0.080710 Oct 28 15:20:02.739794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 182/355] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:02 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28457 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:02.842797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:02.843388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:02.849916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:02.850336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:02.851217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:02.851812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:02.972271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:02.979399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-06b49fb4-8a5a-42d5-b99f-3d5c3ee3e5ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.140240 Oct 28 15:20:02.979955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 174/356] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:03.750958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:03.751981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:03.759340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:03.759785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:03.760588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:03.761269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:03.998214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:03.998824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:04.005904 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:04.006344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:04.007111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:04.007542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:04.039054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-eb43bfed-1613-43d1-843c-9660a2dd2b69 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.292062 Oct 28 15:20:04.039899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 183/357] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:03 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:04.132985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:04.140300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-edb8806f-13c0-44dd-a343-9ca9277b88ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.146664 Oct 28 15:20:04.140888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 175/358] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:05.051112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:05.052697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:05.059658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:05.060104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:05.060900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:05.061331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:05.128569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9a6f4143-f759-4639-ad28-eb1d8545ae4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.081245 Oct 28 15:20:05.129212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 184/359] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:05 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:05.157313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:05.157912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:05.164334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:05.164794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:05.165537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:05.165956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:05.288843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:05.298894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f078d36d-6480-4d7e-91d3-1099587af784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.142747 Oct 28 15:20:05.298894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 176/360] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:06.141212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:06.142205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:06.149504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:06.149974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:06.150737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:06.151167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:06.313220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:06.313830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:06.320028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:06.320514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:06.321288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:06.321715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:06.443391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:06.450483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8daaec10-dcbb-4042-a41c-5d5f6e0439d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.141102 Oct 28 15:20:06.451031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 177/361] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:07.466958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:07.467659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:07.473993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:07.474444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:07.475203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:07.475639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:07.610862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:07.620366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-79350029-f3de-4a0a-9dfa-aa8bc650fd76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.157124 Oct 28 15:20:07.620992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 178/362] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:08.637486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:08.638131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:08.644267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:08.644735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:08.645527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:08.645954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:08.782388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:08.789695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1cfcce5a-f967-4673-86eb-fbb9f55ca20a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.156159 Oct 28 15:20:08.790149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 179/363] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:09.807029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:09.814572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:09.814572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:09.815221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:09.816218 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:09.817492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:09.943826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:09.951044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-759f0cc6-3c34-4eaa-92ac-094c47ee0161 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.148135 Oct 28 15:20:09.951899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 180/364] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:10.968713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:10.969349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:10.976117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:10.976577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:10.977524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:10.978100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:11.103371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:11.110732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ca227557-9c91-4367-ad5f-be72248d2c71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.145957 Oct 28 15:20:11.111288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 181/365] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:12.126422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:12.127103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:12.133809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:12.134241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:12.134998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:12.135420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:12.254057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:12.262075 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-072c6c3e-9b0a-4746-a968-ca541bd77d60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.139271 Oct 28 15:20:12.262629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 182/366] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:12.688302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a249085f-98ae-4370-900e-2442800bda53 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 6.551097 Oct 28 15:20:12.689677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 185/367] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:06 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 6553 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:13.278527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:13.279131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:13.285311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:13.285755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:13.286512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:13.286945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:13.410863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:13.418055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14a22fe2-9cd3-46d6-90de-cea804838743 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.143110 Oct 28 15:20:13.418629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 183/368] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:13.701562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:13.702575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:13.714485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:13.714485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:13.715260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:13.716009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:13.818692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-82130d5b-64f3-4f73-8aff-7d1ee71e1d49 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.121024 Oct 28 15:20:13.819371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 186/369] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:13 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:14.434661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:14.435253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:14.441789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:14.442806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:14.443629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:14.444034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:14.566027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:14.573861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4323f2c3-3b5c-435c-b32e-aea613bf364f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.142954 Oct 28 15:20:14.574409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 184/370] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:14.830205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:14.831288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:14.838788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:14.839458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:14.840232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:14.840695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:14.993134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bf412d81-4a0a-45bc-9500-0ef893684418 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.166737 Oct 28 15:20:14.997041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 187/371] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:14 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:15.590816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:15.591548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:15.598013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:15.599008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:15.599924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:15.600404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:15.739915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:15.748962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b246d546-b6cc-43ff-b30a-001c6dab841b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.161747 Oct 28 15:20:15.749769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 185/372] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:16.005249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:16.006245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:16.013190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:16.013633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:16.014401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:16.014831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:16.277251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-347ff97b-6c96-4485-9df0-859bb1a29421 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.275902 Oct 28 15:20:16.277930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 188/373] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:15 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:16.769080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:16.769809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:16.776439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:16.776884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:16.777646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:16.778165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:16.904951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:16.912646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d36df300-601b-4cc5-adc8-df21d3efdd96 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1520 microversion: 2.1 time: 0.147523 Oct 28 15:20:16.913299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 186/374] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:17.290378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:17.291362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:17.298164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:17.298604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:17.299356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:17.299786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:17.453104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ddf9e8a5-9582-49f2-9b62-de66dacbceb1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.166870 Oct 28 15:20:17.458589 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 189/375] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:17 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:17.929576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:17.930273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:17.936809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:17.937251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:17.938014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:17.938443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.061726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:18.069378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60ff21e1-f501-4e6e-bee2-e9a01abd30fe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1500 microversion: 2.1 time: 0.143633 Oct 28 15:20:18.069961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 187/376] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1500 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:18.096358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0684b6c8-abe8-4e61-ba67-b2794f68eb8f"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:18.097555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:18.105092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.105545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.106317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.106920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.131100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] HTTP exception thrown: Cannot 'attach_volume' instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 while it is in vm_state rescued Oct 28 15:20:18.131902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Returning 409 to user: Cannot 'attach_volume' instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 while it is in vm_state rescued {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:20:18.132953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0e2dadaf-9a21-4bc0-9809-5a9253a6c09e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043540 Oct 28 15:20:18.133646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 190/377] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:20:18 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 15:20:18.142822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:18.143406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:18.149783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.150538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.151970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.151970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.403611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-de52b844-11b7-4bf5-8a2e-5482f665d358 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action" status: 202 len: 0 microversion: 2.1 time: 0.263005 Oct 28 15:20:18.403611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 188/378] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:20:18 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:18.413880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:18.414505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:18.421223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.421824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.422603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.423031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.466880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:18.467881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:18.473819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.474266 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.475041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:18.475457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:18.547662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:18.553969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c72ad66-9386-4b0c-a02c-2a25cd78a8c9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.091114 Oct 28 15:20:18.555214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 189/379] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:18 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:18.557156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3b0e7865-4791-4a80-bc42-9ede65c0b516 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.148041 Oct 28 15:20:18.557719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 191/380] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:19.566497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:19.567450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:19.573928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:19.574373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:19.574537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:19.574809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:19.575570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:19.576167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:19.580823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:19.581270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:19.582068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:19.583007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:19.745799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:19.755658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d83ac951-6290-4292-89aa-12f175ae4f3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.185309 Oct 28 15:20:19.762096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 192/381] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:20.778275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:20.778889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:20.786060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:20.787032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:20.788047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:20.788701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:20.958879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:20.966285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b068e6b3-7d76-4212-8a93-2e3a6d9be844 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.192007 Oct 28 15:20:20.966846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 193/382] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:21.984001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:21.984669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:21.991049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:21.991495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:21.992291 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:21.992764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:22.118397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:22.125575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6528c4dd-5253-4bcd-bba3-e27dc6f6b101 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.145561 Oct 28 15:20:22.126127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 194/383] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:23.147596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:23.148781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:23.155818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:23.156482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:23.157294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:23.157727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:23.327329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:23.335053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-976c30de-8974-489b-84ca-d6c5a6417af2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.193956 Oct 28 15:20:23.335617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 195/384] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:24.352150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:24.352817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:24.359004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:24.359475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:24.360226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:24.360701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:24.542001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:24.549491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dd4e613a-9a79-4357-8e1e-8f7a137d5052 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.201577 Oct 28 15:20:24.550048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 196/385] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:25.567756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:25.568548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:25.574503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:25.574937 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:25.575691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:25.576111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:25.705124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:25.712428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-026bfdb6-6c34-45bd-bfd7-e893b95bb99c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.149034 Oct 28 15:20:25.712837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 197/386] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:26.729035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:26.729710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:26.735827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:26.736267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:26.737072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:26.737501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:26.871524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:26.879674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-546e7355-6981-41cf-b282-1257fe10824c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.153922 Oct 28 15:20:26.880235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 198/387] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:27.897289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:27.897998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:27.903993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:27.904457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:27.905205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:27.905624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:28.022965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:28.030211 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b46f134b-a220-4ad0-8483-db56e511f178 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.137065 Oct 28 15:20:28.030799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 199/388] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:29.047106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:29.047724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:29.054830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:29.055276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:29.056041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:29.056504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:29.133715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-09bd63d4-ee1a-41d5-86d0-dd89d2a896c3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 9.571193 Oct 28 15:20:29.134421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 190/389] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:19 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 9573 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:29.177628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:29.185496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6b219413-2817-4390-b134-9742bbec35d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.142415 Oct 28 15:20:29.186059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 200/390] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:30.146215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:30.147296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:30.154141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:30.154590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:30.155346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:30.155776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:30.202054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:30.202687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:30.208882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:30.209375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:30.210133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:30.210562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:30.286053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f4d49c26-ebd8-48eb-b41e-5b720ba561d0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.143770 Oct 28 15:20:30.286807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 191/391] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:30 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:30.332509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:30.340025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8e0813fe-629b-4c47-8c91-7721c97fca5e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.141798 Oct 28 15:20:30.340616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 201/392] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:31.297926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:31.299071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:31.308299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:31.309008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:31.309794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:31.310223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:31.357987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:31.358565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:31.364769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:31.366775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:31.366775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:31.367035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:31.409850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-63e3b5dc-96a3-443d-bb0d-b57abcd4d12c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.115590 Oct 28 15:20:31.410487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 192/393] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:31 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:31.501755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:31.509539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f72e7859-b43c-4063-a1ca-1d958c7bb1fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.155093 Oct 28 15:20:31.510146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 202/394] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:32.422476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:32.423465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:32.430418 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:32.434186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:32.434186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:32.434186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:32.509853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cafb50e1-47dd-43de-a053-934aa4d4bd59 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.091201 Oct 28 15:20:32.510693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 193/395] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:32 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:32.527168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:32.527773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:32.537145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:32.537145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:32.537145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:32.537145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:32.659907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:32.667628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-075d5dcd-f391-4141-9d5c-1d4b3e74e2b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1508 microversion: 2.1 time: 0.144008 Oct 28 15:20:32.668189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 203/396] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:33.521598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:33.522606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:33.529622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:33.540149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:33.540149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:33.540149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:33.610592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-241238ba-6c0d-43ef-a9ca-8bab19db09a6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.092825 Oct 28 15:20:33.611422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 194/397] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:33 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:33.684957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:33.685592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:33.691992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:33.692530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:33.693353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:33.694179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:33.819022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:33.826915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-db2df735-ace5-45c5-a468-ad488bf4c724 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1514 microversion: 2.1 time: 0.145612 Oct 28 15:20:33.827498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 204/398] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:34.633896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:34.635850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:34.643190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:34.643680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:34.644459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:34.645034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:34.749273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f2eee10-f299-4dbd-8863-4fcbf908a25c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.129664 Oct 28 15:20:34.749932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 195/399] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:34 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:35.761064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:35.762010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:35.769374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:35.769806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:35.770640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:35.771073 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:35.871067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2faa533f-d99a-406e-a82b-bfe73daa44b9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.113573 Oct 28 15:20:35.872376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 205/400] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:35 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:36.547613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:36.548299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:36.555515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.555955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.556744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.557172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.677741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:36.684929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-84a8c332-1454-4786-b8f1-8784e24d976a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1514 microversion: 2.1 time: 0.141279 Oct 28 15:20:36.685487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 196/401] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:36.701997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa9660db-599c-4ff0-9a37-df43e5967c7b"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:36.703125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:36.710760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.711387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.712155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.712607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.883688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:36.884599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:36.891651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.892092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.892928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:36.893359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:36.974412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ebc3091d-ede6-413e-af22-5da9c9cc2f8c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.094987 Oct 28 15:20:36.975057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 197/402] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:36 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:37.705037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-56a0c7b5-4073-4aaa-9789-fc98197d38a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.006847 Oct 28 15:20:37.705581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 206/403] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:20:36 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 194 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:20:37.986723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:37.987710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:37.994457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:37.994892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:37.995642 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:37.996065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:38.091264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1cee441c-979a-466c-a867-29f0c05cb00a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.108621 Oct 28 15:20:38.092733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 198/404] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:37 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:39.104538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:39.105584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:39.111671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:39.112111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:39.112900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:39.113328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:39.184000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-03e7b9da-8210-4c45-8524-f0ee9fb7b020 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.084991 Oct 28 15:20:39.189885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 207/405] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:39 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:40.200285 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:40.201309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:40.207766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:40.208205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:40.212740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:40.213172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:40.302649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-82344a56-7b95-45ff-bdb1-0197137d3efd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.106302 Oct 28 15:20:40.303309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 199/406] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:40 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:41.314940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:41.315939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:41.323326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:41.328503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:41.328503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:41.328503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:41.408289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-43031211-b81b-4082-8a79-32d93552fa34 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.097193 Oct 28 15:20:41.408964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 208/407] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:41 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:42.420198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:42.421233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:42.427997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:42.429030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:42.429849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:42.430309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:42.516984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e6f1aad0-4569-443f-b51c-0de765c0d731 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.100736 Oct 28 15:20:42.517623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 200/408] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:42 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:43.528551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:43.529609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:43.536228 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:43.536708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:43.537486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:43.537971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:43.635481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d54c95a4-957f-4df8-9438-ea69557e84f4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.110780 Oct 28 15:20:43.636329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 209/409] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:43 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:44.648096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:44.649118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:44.655910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:44.656351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:44.657427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:44.657534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:44.786089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f903a9ab-dab9-4fed-9367-d2b8eb98310b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.142525 Oct 28 15:20:44.786900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 201/410] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:44 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:45.798045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:45.799337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:45.806750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:45.807194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:45.807964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:45.808411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:45.879894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e4bcdb88-eadc-4c78-8144-87dbbdd5e6a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.085570 Oct 28 15:20:45.880457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 210/411] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:45 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:46.251875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:46.253028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:46.260172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.260732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.261580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.262082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.285653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lazy-loading 'flavor' on Instance uuid 13279aaf-dc79-4544-b2dc-8c5099d7b405 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:20:46.685352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c51ce07d-8f18-46be-9cbb-c95c7830a840 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action" status: 200 len: 32 microversion: 2.1 time: 0.438369 Oct 28 15:20:46.685352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 202/412] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:20:46 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:20:46.694442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:46.695252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:46.702850 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.703375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.704234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.704787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.831354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:46.839397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c3679bde-79ac-42e5-b906-3ed6df56d13f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.149222 Oct 28 15:20:46.839964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 211/413] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:46.893128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:46.894188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:46.901368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.901880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.902658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:46.903086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:46.983512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5a6d5586-f170-4a54-b6c4-2476effe89f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.095479 Oct 28 15:20:46.985315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 203/414] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:46 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:47.856782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:47.857381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:47.865321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:47.865822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:47.866583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:47.867050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:47.988770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:47.996718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:47.997249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-238596e8-edad-4276-b319-725989c16668 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.143627 Oct 28 15:20:47.998778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:48.006929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 212/415] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:48.011889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:48.012369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:48.026020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:48.026020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:48.157879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eaef18b0-02bb-4083-85cf-af4ebba380d7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.165472 Oct 28 15:20:48.158515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 204/416] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:47 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:49.014022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:49.014645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:49.020907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:49.021345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:49.022650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:49.023078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:49.146460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:49.154658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d0164c4a-c049-4bf3-b1d7-86a307b79d76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.144535 Oct 28 15:20:49.155227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 213/417] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:49.170332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:49.171330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:49.178896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:49.179334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:49.180096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:49.180565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:49.311017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7ae5716e-fd17-4e85-af8e-834a165c3e67 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.144554 Oct 28 15:20:49.319496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 205/418] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:49 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:50.171393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:50.171985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:50.178706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:50.179155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:50.179916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:50.180351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:50.302894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:50.310625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8a6ceaef-f56a-4171-b094-d5e0f1994048 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.142914 Oct 28 15:20:50.311179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 214/419] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:50.323329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:50.324349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:50.331098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:50.331537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:50.332307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:50.332760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:50.426986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7dc7e47a-7714-48e3-be7a-faa37d7fb8b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.107863 Oct 28 15:20:50.427726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 206/420] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:50 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:51.327189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:51.327796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:51.334256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:51.336616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:51.337812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:51.338279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:51.439584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:51.440864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:51.447539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:51.447981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:51.448767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:51.449340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:51.468115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:51.475824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9dd16784-5159-4c4b-9b71-8a9060aeb666 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.151639 Oct 28 15:20:51.476468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 215/421] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:51.560826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-948d13b8-af15-49fe-9af2-049efda0406e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.124714 Oct 28 15:20:51.561915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 207/422] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:51 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:52.493054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:52.493657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:52.499793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:52.500233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:52.501022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:52.501575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:52.574948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:52.577867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:52.584992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:52.585490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:52.586327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:52.586771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:52.634540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:52.642773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-26012dd8-bffa-4784-9555-ec9079312cf2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.153855 Oct 28 15:20:52.643359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 216/423] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:52.651723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7c17d929-27b8-4700-a731-670c914dd4e8 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.081471 Oct 28 15:20:52.652916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 208/424] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:52 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:20:53.389057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:20:53.389309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:20:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:20:53.659340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:53.660070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:53.663909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:53.664931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:53.666898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:53.667333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:53.668092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:53.668544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:53.675447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:53.675896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:53.676756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:53.677187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:53.813093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:53.820881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f9ed4419-14e1-430b-ae2a-b222f7900c01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.165199 Oct 28 15:20:53.821513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 217/425] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:53.858781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1a90b893-cb76-4bf4-95bc-d8d5695cd373 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.199293 Oct 28 15:20:53.862772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 209/426] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:53 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:20:54.837866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:54.838601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:54.844901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:54.845338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:54.846099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:54.846519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:54.871087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:20:54.872079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:54.878959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:54.879399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:54.880153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:54.880606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:55.137999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:55.145636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6381b1f2-8251-41aa-a92e-7db0658d43eb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.311461 Oct 28 15:20:55.146182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 218/427] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:56.164008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:56.164008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:56.170445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:56.171151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:56.172011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:56.172698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:56.301354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:56.309616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a4a28222-f9ee-479d-abdf-dc94e1cc7ccd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.150947 Oct 28 15:20:56.310167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 219/428] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:57.326568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:57.327176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:57.333323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:57.333794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:57.335115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:57.335543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:57.460045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:57.467775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41797f48-74fe-4aa3-987c-bd2de731b805 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.144819 Oct 28 15:20:57.468330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 220/429] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:20:58.484422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:58.485011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:58.491682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:58.492124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:58.492979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:58.493408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:58.625307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:58.633285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ffb9d37b-cff5-460b-a6fb-7dda5838fd3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.152519 Oct 28 15:20:58.633925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 221/430] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:20:59.655739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:20:59.657070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:20:59.673931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:59.674484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:59.675389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:20:59.676130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:20:59.815059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:20:59.823070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-64ae2a02-454c-426f-87ad-d353cf731dc5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.171457 Oct 28 15:20:59.827508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 222/431] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:20:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:00.530670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:21:00.531309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:21:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:21:00.843290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:00.844580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:00.853313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:00.854148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:00.855350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:00.855933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:01.028748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:01.036678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f4a5968c-045f-4f72-b1d8-30db765f77f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.197385 Oct 28 15:21:01.037985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 223/432] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:02.054316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:02.055037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:02.061597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:02.062038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:02.062792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:02.063479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:02.195176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:02.204792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-72d4f00d-3588-4c7d-a3a7-6e76d13eb5b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.153903 Oct 28 15:21:02.205354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 224/433] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:03.221690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:03.222305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:03.229085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:03.229533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:03.230295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:03.230725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:03.361403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:03.370205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f24bd396-50da-49df-b5e8-eec13937294a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.152068 Oct 28 15:21:03.370773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 225/434] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:04.387010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:04.387833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:04.394555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:04.395001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:04.395766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:04.396194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:04.570108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:04.578721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-182ad314-8f7b-4e46-8c0a-4ed0e9e3f778 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.195276 Oct 28 15:21:04.587681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 226/435] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:05.595972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:05.597343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:05.610204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:05.610656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:05.611443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:05.612759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:05.800903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:05.810006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1c22fa4e-5495-4e85-9899-6c87e144f489 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.217581 Oct 28 15:21:05.810597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 227/436] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:06.667203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd33a605-ed51-4e0b-a8ab-b836acbb20c6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 11.799985 Oct 28 15:21:06.672995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 210/437] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:20:54 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 11807 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:06.827286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:06.828897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:06.838744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:06.839274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:06.840062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:06.840695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:06.988076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:06.997970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-34c81445-5c9b-47fb-b8e3-f29388af30f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.174296 Oct 28 15:21:07.009339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 228/438] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:07.691099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:07.699488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:07.719796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:07.720706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:07.722094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:07.722677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:08.015158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:08.016515 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:08.027471 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:08.028414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:08.029813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:08.030952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:08.059442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ad92264d-b5a7-475e-8f38-06a7c94dffb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.381578 Oct 28 15:21:08.061246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 211/439] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:07 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:08.193182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:08.202297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-94e15fc0-1a5c-4238-ac52-c366c5d83158 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.191022 Oct 28 15:21:08.202866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 229/440] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:09.073080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:09.074259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:09.081382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:09.081831 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:09.084561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:09.084561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:09.204317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6980ac2b-caf0-441e-8153-4f1433a43ff0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.135759 Oct 28 15:21:09.211996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 212/441] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:09 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:09.218960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:09.221894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:09.228642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:09.229308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:09.230088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:09.230544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:09.413947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:09.422476 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ed9fb5db-0bc8-4db9-8bee-45c7029ce7e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.207120 Oct 28 15:21:09.432777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 230/442] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:10.219445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:10.250321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:10.250321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:10.250321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:10.250321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:10.250684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:10.433108 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6971c5d6-8c84-4ac6-97db-dfdbba3c8793 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.217448 Oct 28 15:21:10.437635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 213/443] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:10 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:10.442546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:10.444297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:10.451442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:10.451994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:10.452910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:10.455049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:10.606845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:10.619308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d75556a7-74f0-440b-a156-b5fd8741e2f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.181555 Oct 28 15:21:10.619592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 231/444] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:11.446355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:11.447997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:11.457908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:11.458581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:11.460217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:11.460825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:11.637564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:11.641123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:11.654300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:11.655985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:11.657114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:11.657957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:11.707001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2967a5d9-6710-48e3-a428-3a9e34f1ea58 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.265472 Oct 28 15:21:11.724529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 214/445] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:11 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:11.810113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:11.822127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d83ea670-6e1b-40c3-9d45-0107d25a736d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.189018 Oct 28 15:21:11.822696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 232/446] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:12.746368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:12.749439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:12.761879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:12.762776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:12.767410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:12.768903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:12.845217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:12.846877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:12.858303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:12.860524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:12.863037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:12.863583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:13.022962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2ce5c7f1-a697-4f01-a051-9b7d9693b5e1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.283144 Oct 28 15:21:13.024030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 215/447] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:12 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:13.097640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:13.117044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-356d2b56-4197-4ce2-acdc-957f368d56e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.281626 Oct 28 15:21:13.118238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 233/448] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:14.035201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:14.036354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:14.049171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:14.049538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:14.050310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:14.050732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:14.123439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-52c657b3-a4a1-4bcc-b311-c6d7ef99872e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.090253 Oct 28 15:21:14.124784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 216/449] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:14 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:14.135529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:14.136892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:14.147841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:14.148716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:14.149888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:14.150688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:14.310328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:14.323054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb8f0145-0ec0-4ef8-95a5-79080367efe6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.192217 Oct 28 15:21:14.324183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 234/450] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:15.137322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:15.139281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:15.148487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:15.149674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:15.150532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:15.151022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:15.225724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e07e04b-2652-4374-bed7-1d7c79471f0a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.092685 Oct 28 15:21:15.226763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 217/451] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:15 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:15.348060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:15.349424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:15.356859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:15.357803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:15.358975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:15.359654 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:15.514476 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:15.522590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1a62dc81-630f-46dc-874c-bb50b219264d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.178678 Oct 28 15:21:15.523149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 235/452] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:16.238009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:16.239354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:16.247064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:16.247760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:16.248751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:16.249321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:16.372454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-76c4dac7-ecb2-4f46-b675-4be02455a0cd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.138228 Oct 28 15:21:16.376607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 218/453] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:16 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:16.542307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:16.543690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:16.560287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:16.560820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:16.561833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:16.562322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:16.689360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:16.699439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-69379bbf-5cdd-4af7-b044-3a3490ce2a07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.164254 Oct 28 15:21:16.709317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 236/454] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:17.384227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:17.385411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:17.392470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:17.392943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:17.393681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:17.394105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:17.523198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-31437859-878c-4f4d-88c3-16bb448b4bf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.142122 Oct 28 15:21:17.525486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 219/455] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:17 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:17.716200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:17.716854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:17.723374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:17.723803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:17.725138 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:17.725564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:17.860932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:17.870781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-28e9db6c-e7ef-49f2-baa2-e8d2b6517ddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.158141 Oct 28 15:21:17.872472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 237/456] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:18.537428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:18.538575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:18.553836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:18.554329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:18.555165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:18.555603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:18.648865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-aeaa6897-f89c-420e-8af7-9b9a0ae77b4d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.115382 Oct 28 15:21:18.650185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 220/457] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:18 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:18.889726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:18.891028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:18.898151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:18.898599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:18.899371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:18.900119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:19.062104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:19.073857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9b23e7d8-bfcc-44fd-809c-8df59a3944d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.188001 Oct 28 15:21:19.074586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 238/458] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:19.661737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:19.663459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:19.671006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:19.671731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:19.673006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:19.673798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:19.865893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-53b45cea-b700-43b7-973e-ec714a269bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.208254 Oct 28 15:21:19.869969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 221/459] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:19 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:20.091484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:20.092741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:20.099689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:20.100177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:20.103672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:20.104153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:20.243626 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:20.252754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-48393594-5f84-4cdd-824e-34e5bfb27f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.165257 Oct 28 15:21:20.253652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 239/460] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:20.878213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:20.880176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:20.887760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:20.888794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:20.889796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:20.890433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:20.983637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4d4701d9-2439-4a1c-864c-e0946a91d366 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.109183 Oct 28 15:21:20.985937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 222/461] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:20 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:21.034727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdbd5ec6-ce3f-4a21-a543-a0e811a2f5fe", "device": "/dev/sdb"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:21.036521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:21.043044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.043588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.044463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.044898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.277387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:21.277986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:21.284758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.285191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.286236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.286646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.423309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:21.431581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ba1c8afd-6509-4a27-86db-54a62414bb3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1546 microversion: 2.1 time: 0.158442 Oct 28 15:21:21.432143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 223/462] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:21.447439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:21.447924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:21.453792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.454232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.455153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.456060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.588197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] HTTP exception thrown: Cannot 'detach_volume' instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 while it is in vm_state rescued Oct 28 15:21:21.589143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Returning 409 to user: Cannot 'detach_volume' instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 while it is in vm_state rescued {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:21:21.589985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ccf5fd9b-952d-4149-b449-7923eab1f5ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments/fa9660db-599c-4ff0-9a37-df43e5967c7b" status: 409 len: 152 microversion: 2.1 time: 0.146042 Oct 28 15:21:21.590527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 224/463] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:21:21 2021] DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments/fa9660db-599c-4ff0-9a37-df43e5967c7b => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 15:21:21.598431 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:21.598991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:21.606107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.606552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.607321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.607755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.954679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2fba69af-1fce-4225-9e08-527421c4d42e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action" status: 202 len: 0 microversion: 2.1 time: 0.359479 Oct 28 15:21:21.959938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 225/464] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:21:21 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:21.965328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:21.966261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:21.973959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.976972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:21.979582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:21.979582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:22.371567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:22.391110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-47856ebd-f9e6-4a91-8c0e-9f873a7865bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1554 microversion: 2.1 time: 0.429523 Oct 28 15:21:22.405097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 226/465] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1554 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:22.411063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:22.414999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:22.421446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:22.421971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:22.422985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:22.423485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:22.498498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f31b4aed-66d3-4512-88cc-f8f019854796 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.090879 Oct 28 15:21:22.499164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 227/466] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:22 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:22.697694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-39e12f42-d285-42d6-aca3-a852dde77f78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "POST /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.666692 Oct 28 15:21:22.699666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 240/467] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:21:21 2021] POST /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86/os-volume_attachments => generated 194 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:23.212282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Action: 'create', calling method: .version_select at 0x7fdc1817bdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1268459958"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:23.252066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:21:23.257252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for user ea2d6e911eb44e8a93f98349f0a07568 and project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:21:23.412216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:23.413421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:23.419595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:23.420047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:23.420856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:23.421278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:23.543473 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:21:23.547199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for user ea2d6e911eb44e8a93f98349f0a07568 and project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:21:23.560048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d2d2db0c-76a8-4d2b-b974-b64d386f34ea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.353858 Oct 28 15:21:23.560760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 228/468] 10.222.0.86 () {60 vars in 1157 bytes} [Thu Oct 28 15:21:23 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:23.560870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:23.565939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:23.566971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:23.570302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b8b0d1fe-5084-48a0-af63-20305f9c80b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1554 microversion: 2.1 time: 0.162644 Oct 28 15:21:23.571175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 241/469] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:23.580790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:23.580790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:23.580790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:23.580790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:23.665676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1661810731", "imageRef": "80545509-4e4f-4d29-9d4c-d13e004e7bd5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1268459958", "networks": [{"uuid": "550e741c-476f-417d-af0a-6362fb10f867"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:23.718309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] validate_networks() for [('550e741c-476f-417d-af0a-6362fb10f867', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:21:23.723250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-58f9ff23-85b4-435d-8c47-6998b0d9d14e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.160945 Oct 28 15:21:23.725349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 229/470] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:23 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:24.093273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:21:24.093692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:21:24.094193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:21:24.094598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:21:24.095008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:21:24.104245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.105241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.106090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.106518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.123426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:21:24.127317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Getting quotas for user ea2d6e911eb44e8a93f98349f0a07568 and project 467a52d2070d47d0ad9109b96bdd6f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:21:24.138849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:21:24.141145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80545509-4e4f-4d29-9d4c-d13e004e7bd5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:21:24.266918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-673aa47d-828b-43d6-86f6-35f36d24a20b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604846 Oct 28 15:21:24.270126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 242/471] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:21:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 15:21:24.277546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c660e87d-483f-4e91-af38-75109ff7ba27 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:24.278260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c660e87d-483f-4e91-af38-75109ff7ba27 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:24.337613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c660e87d-483f-4e91-af38-75109ff7ba27 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:24.344928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c660e87d-483f-4e91-af38-75109ff7ba27 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1259 microversion: 2.1 time: 0.071260 Oct 28 15:21:24.345618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 230/472] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:24 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:24.587730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:24.588368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:24.594404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.594852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.595627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.596057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.732353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:24.743608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5d1b7ee4-cb14-49e0-a230-a504a9eda02c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1554 microversion: 2.1 time: 0.160302 Oct 28 15:21:24.744858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 243/473] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:24.758796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:24.759878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:24.767021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.767386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.768163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:24.768677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:24.857387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fef9202f-0d22-46a0-86b0-9f6a1ddcd717 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.119705 Oct 28 15:21:24.858063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 231/474] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:24 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:25.362492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dc0a032e-b86e-4264-bd4f-b7e0b0f4b10a tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:25.363100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dc0a032e-b86e-4264-bd4f-b7e0b0f4b10a tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:25.420708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dc0a032e-b86e-4264-bd4f-b7e0b0f4b10a tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:25.436622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dc0a032e-b86e-4264-bd4f-b7e0b0f4b10a tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1259 microversion: 2.1 time: 0.070145 Oct 28 15:21:25.436622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 244/475] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:25 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:25.763049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:25.764009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:25.770552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:25.770993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:25.776558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:25.776558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:25.873068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:25.878098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:25.895317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:25.897122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:25.900860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:25.902156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:25.955913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:25.967599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c1ce527-ac2d-4555-ba7a-7b3c75724dc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1554 microversion: 2.1 time: 0.208556 Oct 28 15:21:25.968244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 232/476] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:26.009865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e9a397ab-cd4f-4b3e-aba9-21561a54afe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.143692 Oct 28 15:21:26.011158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 245/477] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:25 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:26.450520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:26.450520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:26.455303 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:26.455756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:26.456555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:26.456987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:26.523985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:26.531288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4125d060-5d1b-4745-b653-e162682e8f4b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1263 microversion: 2.1 time: 0.087869 Oct 28 15:21:26.531859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 233/478] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:26 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:26.986647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:26.987157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:26.996147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:26.997126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:26.998165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:26.998942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.027440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:27.027440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:27.032513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.033187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.034010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.034499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.103504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-42e20d0e-6667-4e6d-9d19-ac0100fcf740 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.083751 Oct 28 15:21:27.105080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 234/479] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:27 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:27.138073 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:27.147099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a236fe32-1092-42d6-b126-483f051c7fe3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1560 microversion: 2.1 time: 0.165363 Oct 28 15:21:27.147840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 246/480] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:27.216165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:27.216165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:27.223547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.223987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.224818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.225236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.305057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lazy-loading 'services' on Instance uuid 13279aaf-dc79-4544-b2dc-8c5099d7b405 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:21:27.548370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:27.548989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:27.555921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.556355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.557152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.557576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.617479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a615d7d9-e703-4ec0-a5a3-f0d2ca022f6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments/fa9660db-599c-4ff0-9a37-df43e5967c7b" status: 202 len: 0 microversion: 2.1 time: 0.405141 Oct 28 15:21:27.619173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:27.620648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 235/481] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:21:27 2021] DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments/fa9660db-599c-4ff0-9a37-df43e5967c7b => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:27.626895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-617db49f-8de1-4dd4-8da6-759b62745d22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1319 microversion: 2.1 time: 0.082153 Oct 28 15:21:27.628481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 247/482] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:27 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:27.630312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:27.631446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:27.637889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.638327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.639626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:27.640306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:27.672242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e9de69c4-d917-43b3-a817-47b3e7e4c380 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049737 Oct 28 15:21:27.673088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 236/483] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:28.116594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:28.116594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:28.123414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.123878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.124674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.125113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.233275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2a54ee47-6933-46fb-8313-4ec548dd9f57 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 28625 microversion: 2.20 time: 0.121524 Oct 28 15:21:28.233927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 248/484] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:28 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 28625 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:21:28.647260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:28.647941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:28.654529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.655316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.656508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.657160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.684403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:28.685414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:28.710156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.710840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.711747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:28.712172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:28.794486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1403e6b2-053c-4410-a361-9e6d3d739a33 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114275 Oct 28 15:21:28.797351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 249/485] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:28.863982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:28.876545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e4b8962f-9ff2-4601-a842-13b9310c4a44 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.229004 Oct 28 15:21:28.876545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 237/486] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:28 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:29.246717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:29.251055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:29.258248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.258745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.261206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.271985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.751847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-72e31f68-b35f-4d4f-a76a-4fc4c3570a3e req-8167fa95-7a3b-43e7-89b3-b1931131d735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b317ef-28ae-443d-9981-0dc1561cdcab", "tag": "0f927fe4-ef21-420a-b6f9-4363b60dfe6e"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:29.754031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:21:29.754031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:21:29.765184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-72e31f68-b35f-4d4f-a76a-4fc4c3570a3e req-8167fa95-7a3b-43e7-89b3-b1931131d735 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.765184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-72e31f68-b35f-4d4f-a76a-4fc4c3570a3e req-8167fa95-7a3b-43e7-89b3-b1931131d735 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.777887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-72e31f68-b35f-4d4f-a76a-4fc4c3570a3e req-8167fa95-7a3b-43e7-89b3-b1931131d735 service nova] Creating event network-changed:0f927fe4-ef21-420a-b6f9-4363b60dfe6e for instance 66b317ef-28ae-443d-9981-0dc1561cdcab on hv-cinder-78364 Oct 28 15:21:29.782960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-72e31f68-b35f-4d4f-a76a-4fc4c3570a3e req-8167fa95-7a3b-43e7-89b3-b1931131d735 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037494 Oct 28 15:21:29.786782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 238/487] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:21:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:29.807970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:29.813973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:29.815879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.816515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.817335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.817767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.862584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dd1f0355-1c1e-4558-85ec-817ba93ef382 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058824 Oct 28 15:21:29.863184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 239/488] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:29.890135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:29.890744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:29.897032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.897716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:29.898691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:29.899328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:30.043950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:30.051711 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-294ce9c2-d291-41af-bf41-2d710f2c5edd tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.165405 Oct 28 15:21:30.053911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 240/489] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:29 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:30.874699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:30.875703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:30.883390 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:30.884188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:30.885556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:30.886262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:30.925003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0a27ae43-69f7-4766-85dc-c93b633053b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054063 Oct 28 15:21:30.925552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 241/490] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:31.069814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:31.070413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:31.076238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:31.076694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:31.077441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:31.077867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:31.201256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:31.215574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cd78b2be-5c71-4e1d-8a15-f703564b1f13 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.149776 Oct 28 15:21:31.216835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 242/491] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:31 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:31.938041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:31.939531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:31.947700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:31.948280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:31.949155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:31.949824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:31.980420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6eab444d-28cf-416b-9302-54f0135a98c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047079 Oct 28 15:21:31.980983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 243/492] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:32.232872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:32.233472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:32.239215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:32.239657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:32.240790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:32.241217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:32.361353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:32.368629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cdd95b96-73f7-45b3-a950-d712e7a0368d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.139325 Oct 28 15:21:32.369229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 244/493] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:32 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:32.992265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:32.993198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:32.999446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:32.999832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:33.000633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:33.001106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:33.035631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c4c763ca-d468-4b34-97da-534fe43232f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Oct 28 15:21:33.036192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 245/494] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:33.384289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:33.385076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:33.392547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:33.393113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:33.393902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:33.394332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:33.526121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:33.533358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-184e13fc-40f7-4c42-b476-a820dc3277b2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.152951 Oct 28 15:21:33.533921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 246/495] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:33 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:34.047060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:34.047956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:34.054121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:34.054558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:34.055304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:34.055725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:34.084141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37002742-9c20-43fe-bb34-5f6fbe7d058b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040144 Oct 28 15:21:34.084720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 247/496] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:34.550850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:34.551564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:34.557901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:34.558496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:34.559277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:34.559798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:34.682140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:34.689297 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-18c001bb-d67d-4fe2-a7ca-46e3699cc559 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.142150 Oct 28 15:21:34.689853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 248/497] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:34 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:35.095054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:35.095980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:35.102959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:35.103403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:35.104174 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:35.104640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:35.133709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e46c526b-481d-4b6b-a85e-58460c77c64e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 Oct 28 15:21:35.134250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 249/498] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:35.712339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:35.712339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:35.722794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:35.723575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:35.725836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:35.726402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:35.851585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:35.861312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1d65a896-1ad0-46c6-b034-b0f8c884faac tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.158561 Oct 28 15:21:35.861875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 250/499] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:35 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:36.145375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:36.147048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:36.153738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:36.154198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:36.154924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:36.155413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:36.185690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5f205077-c993-44f1-8d3d-b95f31d03657 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Oct 28 15:21:36.186229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 251/500] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:36.878177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:36.878977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:36.885036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:36.885480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:36.886253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:36.886683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:37.007195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:37.014583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8108aae3-1c58-4148-9020-a964cf4dfd67 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.139984 Oct 28 15:21:37.015141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 252/501] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:36 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:37.197127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:37.198033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:37.204241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:37.204719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:37.205489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:37.205923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:37.236228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9ecd41e4-343f-4b58-b178-21d3ea86288f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Oct 28 15:21:37.236819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 253/502] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:38.032905 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:38.033572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:38.040143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:38.040682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:38.041463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:38.041896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:38.178981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:38.186805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0c4b26b3-3468-4b8a-bf5a-6883ca8add94 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.158057 Oct 28 15:21:38.187385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 254/503] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:38 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:38.246861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:38.247976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:38.254188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:38.254631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:38.256094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:38.256562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:38.285607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bf814cbf-34cb-4c48-a166-456f08f0371b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Oct 28 15:21:38.286159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 255/504] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:39.204256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:39.204885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:39.211294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:39.211754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:39.212632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:39.213085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:39.336852 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:39.344313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-47c651e5-722e-4b87-9bb0-78c02eef965d tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.143939 Oct 28 15:21:39.344899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 256/505] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:39 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:39.349469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:39.350493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:39.356323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:39.356796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:39.357578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:39.358000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:39.386339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bfbaa02c-6721-4312-a754-f7bde13b4d8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 Oct 28 15:21:39.386887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 257/506] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:40.361442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:40.362037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:40.368265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:40.368766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:40.369511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:40.369930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:40.526433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:40.534084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-65465d51-cf3e-4633-ac20-da4e88961b5f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.176769 Oct 28 15:21:40.539723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 258/507] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:40 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:40.540069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:40.541049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:40.547213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:40.547657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:40.548804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:40.549234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:40.578500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-711b4949-9ad4-47c9-85f2-7d970dcc6dfe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Oct 28 15:21:40.579063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 259/508] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:41.550992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:41.551664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:41.558138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:41.558562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:41.559371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:41.559934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:41.693459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:41.700569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-04ea7d96-fc13-4b46-9c6f-e587b083a516 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.153429 Oct 28 15:21:41.701127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 260/509] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:41 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:41.705520 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:41.710190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:41.712409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:41.712886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:41.713660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:41.714090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:41.745294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-300bf4ac-108b-4bbe-b33f-048078982281 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 Oct 28 15:21:41.745874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 261/510] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:42.717514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:42.718238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:42.725118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:42.725635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:42.726413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:42.726843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:42.892005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:42.899272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9f2369b-d6e9-48a2-941e-3bb7b7a59df5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.185675 Oct 28 15:21:42.899826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 262/511] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:42 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:42.904171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:42.905095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:42.912858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:42.913309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:42.914278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:42.914791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:42.946328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f93421a-9e87-49f6-a851-6ad4cb063071 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Oct 28 15:21:42.946892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 263/512] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:43.916380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:43.917100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:43.923193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:43.923636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:43.924640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:43.925101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:44.176716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:44.186472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-63f21f72-81e0-4efe-9b95-49f01fd0e289 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.273792 Oct 28 15:21:44.192719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 264/513] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:43 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:44.198190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:44.200059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:44.206959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:44.207456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:44.208265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:44.208818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:44.254163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d935fc61-bd35-4985-9b13-acd8cd12c0ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065917 Oct 28 15:21:44.255161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 265/514] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:45.202997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:45.203676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:45.211010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:45.221034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:45.229487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:45.230196 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:45.391384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:45.402815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b1470476-bba9-4869-8926-aed70d1d6126 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.203578 Oct 28 15:21:45.409678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 266/515] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:45 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:45.415716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:45.420517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:45.435654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:45.436681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:45.437645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:45.438241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:45.478420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-03e1f8f8-e535-4c67-a5a8-2b9f22d3cf36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067595 Oct 28 15:21:45.482847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 267/516] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:46.420344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:46.421784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:46.428923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:46.429777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:46.430792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:46.431398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:46.716913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:46.725841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-597e4193-7b48-4bb3-a90c-e6d77bdfb2d7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.309114 Oct 28 15:21:46.750029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 268/517] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:46 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:46.765383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:46.766185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:46.799219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:46.803377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:46.804364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:46.805013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:46.869209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d8f65199-b726-4c10-a9e1-5c705669fc0e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115334 Oct 28 15:21:46.871118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 269/518] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:47.757598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:47.758260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:47.765175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:47.765622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:47.771900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:47.771900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:47.973207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:47.980599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ff7c447e-e7f2-4ec4-afe0-5d1087733c4f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.228553 Oct 28 15:21:47.981165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 270/519] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:47 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:47.994632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:47.995892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:48.002190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:48.002637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:48.003443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:48.003880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:48.060917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5a65a69c-c6b5-42df-9cbc-ed43c262dd60 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078494 Oct 28 15:21:48.061597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 271/520] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:48.998924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:48.999824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:49.007911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:49.008802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:49.009771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:49.010363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:49.198201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:49.205754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b8a45c4f-8862-4787-a5df-241ce979a1b7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.211360 Oct 28 15:21:49.206314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 272/521] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:48 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:49.211302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:49.212252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:49.225638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:49.226199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:49.226856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:49.227399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:49.259089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3f1fa2c4-8f1e-4697-80a1-6eda39233c31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051491 Oct 28 15:21:49.259592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 273/522] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:49.740434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e83a124c-ca05-48c2-962b-728b13c36431 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 33411 microversion: 2.20 time: 20.496690 Oct 28 15:21:49.743060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 250/523] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:29 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 33411 bytes in 20500 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:50.222075 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:50.222809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:50.228619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.229055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.229813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.230240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.271906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:50.277057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:50.286830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.287360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.288203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.288722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.320324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-36caa2e1-357e-4384-9bcf-2b0c32c74133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053144 Oct 28 15:21:50.321338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 251/524] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:50.373167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:50.383025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e0f0140-4c74-436d-ac7e-aa074183a6cb tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.164177 Oct 28 15:21:50.393449 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 274/525] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:50 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:50.755194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:50.756222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:50.762472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.762921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.763704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:50.767281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:50.876622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-949856c4-de46-488c-b8ac-6db2feb80414 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 33814 microversion: 2.20 time: 0.126388 Oct 28 15:21:50.881023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 252/526] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:50 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 33814 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:51.331617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:51.332549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:51.339229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.339666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:51.340554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.340849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:51.371659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c97174d1-48a3-45b1-a05f-13d78d7e164e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Oct 28 15:21:51.372136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 275/527] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:51.402233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:51.403225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:51.417433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.417433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:51.417751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.418181 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:51.563908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:51.572466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ca84ea54-191c-4d36-bc3e-086fe3b02d76 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.174570 Oct 28 15:21:51.573047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 253/528] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:51 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:51.896771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:51.898105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:51.904466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.905102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:51.905988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:51.906510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:52.016259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-61130b62-92f6-4822-9a9e-505b7f3edc4e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 34677 microversion: 2.20 time: 0.123793 Oct 28 15:21:52.017234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 276/529] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:51 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 34677 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:52.383285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:52.384267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:52.391261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:52.391704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:52.392549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:52.393478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:52.431791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-809d3599-adfd-4971-92dd-21ec6abca9d5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052372 Oct 28 15:21:52.435991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 254/530] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:52.588766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:52.589457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:52.596752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:52.597237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:52.599686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:52.600287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:52.735289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:52.745129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8cde3ea2-3e26-4dfb-bda8-e3ce3cf26afa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.160352 Oct 28 15:21:52.745738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 277/531] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:52 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:53.027245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:53.028257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:53.038294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.039829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.041580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.042405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.148581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ce90cc8c-4f18-429e-be9e-1ed1ff0da4af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 35148 microversion: 2.20 time: 0.124610 Oct 28 15:21:53.151219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 255/532] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:53 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 35148 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:53.443692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:53.445042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:53.451280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.452156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.453255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.453868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.492716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-41337b1d-ed56-46d1-b761-f803a9b269e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053206 Oct 28 15:21:53.497156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 278/533] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:53.762787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:53.763472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:53.772058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.772768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.773736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:53.774350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:53.924332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:53.937510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-56c12bea-1ec4-485d-aad9-d0eb16c3f2b4 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.179155 Oct 28 15:21:53.938611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 256/534] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:53 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:54.162175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:54.163208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:54.169822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.170352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:54.171200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.171705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:54.283922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d29a3bcd-263e-4939-843a-93e36a9bab78 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 36102 microversion: 2.20 time: 0.125648 Oct 28 15:21:54.284491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 279/535] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:54 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 36102 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:54.515675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:54.522622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:54.534488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.534901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:54.535707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.536147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:54.577413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b6e8f2e7-b294-4764-81a4-0b7f07ef4e09 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075461 Oct 28 15:21:54.578369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 257/536] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:54.956451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:54.956685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:54.963924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.964374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:54.965158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:54.965585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:55.165466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:55.176688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e1d7118c-c11a-4a21-8014-37a96e9a10ba tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.224624 Oct 28 15:21:55.186320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 280/537] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:54 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:55.304059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:55.305780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:55.317704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:55.323112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:55.324378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:55.325634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:55.589807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:55.590848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:55.597109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:55.597644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:55.598410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:55.599375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:55.636937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-07655b21-68ca-4bb9-b02b-e266b5e36076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Oct 28 15:21:55.636937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 281/538] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:56.194014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:56.195353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:56.207043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:56.207491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:56.208308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:56.208769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:56.375471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:56.387120 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-56e874ac-283e-4058-b025-229832cfefb7 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.197244 Oct 28 15:21:56.388133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 282/539] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:56 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:56.643495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:56.644437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:56.650625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:56.651300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:56.652063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:56.652511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:56.683983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f2c1a92e-f1be-4c23-86bf-b9e0cfe7a968 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Oct 28 15:21:56.684572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 283/540] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:21:57.452559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Action: 'create', calling method: .version_select at 0x7fdc1804fdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1195942847"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:21:57.489689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Getting quotas for project 795c4c9c3ddd4197b8bd5895d24b5555. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:21:57.493642 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Getting quotas for user 0035c9a8811e468a996131546544253e and project 795c4c9c3ddd4197b8bd5895d24b5555. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:21:57.726444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Getting quotas for project 795c4c9c3ddd4197b8bd5895d24b5555. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:21:57.729997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Getting quotas for user 0035c9a8811e468a996131546544253e and project 795c4c9c3ddd4197b8bd5895d24b5555. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:21:57.743012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c9b6cac3-ca94-4a20-8312-cb1bbaf1a8e9 tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.480323 Oct 28 15:21:57.743604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 284/541] 10.222.0.86 () {60 vars in 1157 bytes} [Thu Oct 28 15:21:57 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:21:57.748993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:57.749591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:57.756329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:57.756877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:57.757750 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:57.758176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:57.897091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:57.906465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e4b37e02-b279-4ce0-ae60-b698e2926e22 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.160973 Oct 28 15:21:57.916580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 285/542] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:57 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:57.917654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:57.919082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:57.925483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:57.926060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:57.927604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:57.928159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:57.957404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ea9d393f-1bb1-4fa4-b5b2-56da47a7b182 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048949 Oct 28 15:21:57.957981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 286/543] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:21:58.924083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:58.924652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:58.930727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:58.931160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:58.931923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:58.932347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:59.067380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:21:59.079518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4961526c-0a84-4bdd-b316-01eeb21a5d28 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.158108 Oct 28 15:21:59.088996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 287/544] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:21:58 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:21:59.088996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:21:59.088996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:21:59.092845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e20b455b-3bed-49d7-821a-591e7be38474 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 38177 microversion: 2.20 time: 3.793081 Oct 28 15:21:59.094858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:59.100160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:59.100284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 258/545] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:21:55 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 38177 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:21:59.100422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:21:59.100422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:21:59.133711 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0ab60a45-4a18-4ce0-8a6e-9914128b0154 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052477 Oct 28 15:21:59.139370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 288/546] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:21:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:00.096827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:00.097527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:00.106455 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.106906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.107677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.108318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.111257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:22:00.112289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:00.127649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.129639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.134442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.134442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.288679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:00.290478 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-47a36ec9-17bc-426e-a51c-5692fa9d8760 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 38177 microversion: 2.20 time: 0.183916 Oct 28 15:22:00.291187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 289/547] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:22:00 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 38177 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:22:00.297702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-079c50e6-865a-4fab-ae79-ab385a4f2ccf tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.204179 Oct 28 15:22:00.298923 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 259/548] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:00 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:00.300447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:00.301443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:00.311980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.312455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.313975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:00.313975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:00.351260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9d5fba53-128f-4af0-a197-b7668ef0e342 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055284 Oct 28 15:22:00.366701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 290/549] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:01.303006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:22:01.304056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:01.312339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.313301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.314800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.315070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:01.315687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:01.316186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.323692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.324145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.324987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.325582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.467499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:01.475367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ad0694c1-c566-4540-a416-e41d185e8be8 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.164986 Oct 28 15:22:01.476353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 291/550] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:01 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:22:01.480864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:01.481987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:01.489647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.490096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.490862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:01.491295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:01.535811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9fac0681-45dc-4c39-8eeb-f456711761d4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Oct 28 15:22:01.535811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 292/551] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:02.492913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:02.493566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:02.500084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:02.500579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:02.501362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:02.501792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:02.627243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:02.635923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d36359d0-7dfe-4092-837c-ecd544223ef5 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.147210 Oct 28 15:22:02.636537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 293/552] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:02 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:22:02.641465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:02.642365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:02.648280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:02.648758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:02.649537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:02.649998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:02.686496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-67c6f7b5-2f93-4833-8c7a-a2a8f123548e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048717 Oct 28 15:22:02.687287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 294/553] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:03.652634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:03.653264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:03.659248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:03.659954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:03.660734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:03.661752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:03.779017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:03.786744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fa2c5261-8446-4792-8287-28d85ea12147 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.137273 Oct 28 15:22:03.787592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 295/554] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:03 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:22:03.791723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:03.792691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:03.798380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:03.798823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:03.799882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:03.800001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:03.829698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a127e4a0-6d80-4d74-a5cb-cbbaf1f71944 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Oct 28 15:22:03.830268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 296/555] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:04.802668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:04.803300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:04.809501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:04.809940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:04.810685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:04.811113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:04.938959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:04.946790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-87baa2d3-20f4-463a-91c6-7fb87a3719fa tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.147718 Oct 28 15:22:04.947358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 297/556] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:04 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:22:04.951837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:04.952781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:04.962488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:04.963019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:04.963710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:04.964147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:04.994363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-169ee8f2-341d-4053-858b-da003517adf3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Oct 28 15:22:04.994848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 298/557] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:05.638309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-93e281b2-699d-4004-8225-8149d2d3b026 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action" status: 200 len: 38320 microversion: 2.20 time: 4.339409 Oct 28 15:22:05.639390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 260/558] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:22:01 2021] POST /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/action => generated 38320 bytes in 4341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:22:05.649017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:05.649427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:05.655221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:05.655650 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:05.656413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:05.656926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:05.680584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a14379f2-06cf-4568-aaa7-97b25a9272e4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/ips" status: 200 len: 152 microversion: 2.20 time: 0.035174 Oct 28 15:22:05.681142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 299/559] 10.222.0.86 () {60 vars in 1288 bytes} [Thu Oct 28 15:22:05 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:22:05.964429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:05.965308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:05.972617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:05.973064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:05.974510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:05.974943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:06.005996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:06.007529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:06.014451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:06.015193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:06.016007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:06.016460 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:06.055665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-531a2269-ab4f-46d6-a44d-af816e15c28d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050155 Oct 28 15:22:06.055665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 300/560] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:06.124744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:06.133781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0a1c46fb-81f4-4b2d-afc0-469b4f871dea tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.173545 Oct 28 15:22:06.134384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 261/561] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:05 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:06.315193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-f0f09378-e022-47ad-8009-0f2e87c04e15 req-1202fc12-adc5-4c21-ace0-4bc1bd9844d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b317ef-28ae-443d-9981-0dc1561cdcab", "name": "network-vif-plugged", "status": "completed", "tag": "0f927fe4-ef21-420a-b6f9-4363b60dfe6e"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:22:06.317004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:22:06.317004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:22:06.324010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f0f09378-e022-47ad-8009-0f2e87c04e15 req-1202fc12-adc5-4c21-ace0-4bc1bd9844d6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:06.324466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f0f09378-e022-47ad-8009-0f2e87c04e15 req-1202fc12-adc5-4c21-ace0-4bc1bd9844d6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:06.335119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-f0f09378-e022-47ad-8009-0f2e87c04e15 req-1202fc12-adc5-4c21-ace0-4bc1bd9844d6 service nova] Creating event network-vif-plugged:0f927fe4-ef21-420a-b6f9-4363b60dfe6e for instance 66b317ef-28ae-443d-9981-0dc1561cdcab on hv-cinder-78364 Oct 28 15:22:06.341262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-f0f09378-e022-47ad-8009-0f2e87c04e15 req-1202fc12-adc5-4c21-ace0-4bc1bd9844d6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028613 Oct 28 15:22:06.341262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 301/562] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:07.063084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:07.063993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:07.070190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:07.070632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:07.071378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:07.071798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:07.100785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-847a4378-8482-4bce-9c10-cc82b16a87e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 Oct 28 15:22:07.101541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 262/563] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:22:07.152052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:07.152753 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:07.159048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:07.159491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:07.160283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:07.160733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:07.477565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:07.477565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1eac6868-010c-402e-8926-4a40b166bad2 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.153224 Oct 28 15:22:07.477565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 302/564] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:07 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:08.112724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:08.113542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:08.119662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:08.120098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:08.120882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:08.121304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:08.149636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4d7aa515-c1a4-4676-901b-7189b0711e22 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 Oct 28 15:22:08.150181 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 263/565] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:08.490544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:08.491546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:08.497302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:08.497738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:08.498504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:08.498929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:08.624495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:08.632186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-279c3e8b-4a7a-41ee-a657-1b633f53599e tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1359 microversion: 2.1 time: 0.145226 Oct 28 15:22:08.632774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 303/566] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:08 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:22:09.161000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:09.161809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:09.168033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.168499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.169261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.169683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.197681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-04acafb2-8276-4259-9b3e-f014b6667f74 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040494 Oct 28 15:22:09.198219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 264/567] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:09.648940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:09.649560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:09.655700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.656134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.656990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.657415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.780058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:09.787407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c2b5ad5b-8c4e-4339-bf2d-8e16c41d7801 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1549 microversion: 2.1 time: 0.142155 Oct 28 15:22:09.787965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 304/568] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:09 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:09.803883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:09.804608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:09.810369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.810848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.811611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.812064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.934418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:09.941819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2783d5a5-a182-4747-af6c-283c594dfa6c tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1549 microversion: 2.1 time: 0.142060 Oct 28 15:22:09.942449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 265/569] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:09 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:09.957206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:09.960501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:22:09.960501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:22:09.961495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:09.962235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Searching by: {'deleted': False, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b'} {{(pid=116431) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 15:22:09.969067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.969512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:09.970358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:09.970787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:10.066192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.multi_cell_list [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 15:22:10.160781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f3448225-bf0f-4134-8583-459e01d82e2b tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207179 Oct 28 15:22:10.161899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 305/570] 10.222.0.86 () {58 vars in 1124 bytes} [Thu Oct 28 15:22:09 2021] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:10.171725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:10.172320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:10.179044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:10.179477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:10.180220 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:10.180662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:10.208769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:10.209737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:10.215600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:10.216038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:10.216821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:10.217251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:10.248332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5763c73d-cde7-410f-b30b-daee412afe8d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Oct 28 15:22:10.248928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 306/571] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:22:10.305511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:22:10.313724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-717b2026-a461-408a-b8e7-41274108d0ce tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1549 microversion: 2.1 time: 0.145663 Oct 28 15:22:10.314369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 266/572] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:22:10 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:22:11.259357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:11.260263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:11.266879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:11.267417 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:11.268246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:11.268807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:11.304495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fec75007-fa78-41e9-944b-4a1edb8b5036 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049476 Oct 28 15:22:11.305057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 307/573] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:12.315999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:12.316945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:12.323780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:12.324224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:12.325041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:12.325473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:12.361329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5f55f3cc-6fc9-4358-bbf5-58e483fd3e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Oct 28 15:22:12.364792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 267/574] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:13.371978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:13.372894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:13.378993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:13.379452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:13.380190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:13.381433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:13.410588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e87937c5-964a-4cdb-863a-cd1a1c268cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Oct 28 15:22:13.411282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 308/575] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:14.421725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:14.422720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:14.429079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:14.429517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:14.430275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:14.430700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:14.460289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6ee805d2-d87a-4424-89bd-1c81fa549926 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Oct 28 15:22:14.460871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 268/576] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:15.470796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:15.471698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:15.478056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:15.478498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:15.479253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:15.479679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:15.509709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-46cecaaf-3007-486f-aa04-0329c95ec07a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Oct 28 15:22:15.510276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 309/577] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:16.521509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:16.522429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:16.528761 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:16.529194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:16.529947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:16.530366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:16.558761 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-05b835b1-7089-40c4-9138-820317094a4e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Oct 28 15:22:16.559308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 269/578] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:22:17.570048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:17.570951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:17.577141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:17.577585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:17.578339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:17.578765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:17.608410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b6995fef-4b12-4398-972b-8bc36af571d6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Oct 28 15:22:17.609107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 310/579] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:18.620752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:18.621682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:18.627771 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:18.628213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:18.628995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:18.629415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:18.659330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-98465e54-cbd9-456a-a41c-2a0d425a0c1e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Oct 28 15:22:18.659910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 270/580] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:19.670712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:19.671610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:19.677957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:19.678399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:19.679156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:19.679582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:19.709134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a860c83c-1ba9-46b8-903c-f637bd8e65b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Oct 28 15:22:19.712981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 311/581] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:20.720444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:20.721353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:20.728417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:20.728905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:20.729780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:20.730235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:20.760595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6c71121f-0618-4297-bdb1-a6445bf94fde tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Oct 28 15:22:20.761223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 271/582] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:21.771815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:21.772758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:21.779149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:21.779592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:21.780351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:21.780804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:21.813206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eff2844b-cfc8-4106-b26a-0f6d068eb06e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Oct 28 15:22:21.818037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 312/583] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:22.827659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:22.828529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:22.835514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:22.835953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:22.836750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:22.837183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:22.868132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ecb86853-f1fd-41d8-9ad1-32f0e1565f1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Oct 28 15:22:22.868975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 272/584] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:23.879056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:23.879969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:23.887172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:23.887561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:23.888328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:23.888780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:23.921224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bb68d68f-ba6b-4419-96ab-920310fe3b9a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Oct 28 15:22:23.921777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 313/585] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:24.932249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:24.933185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:24.939228 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:24.939670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:24.940461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:24.940889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:24.969010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f6e62a38-4651-4eb1-bae9-c494da5419c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041061 Oct 28 15:22:24.969554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 273/586] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:25.978864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:25.979765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:25.986062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:25.986260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:25.987012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:25.987432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:26.016693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-90d7de1e-5ae5-458a-955c-c7c606100fe2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041453 Oct 28 15:22:26.017523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 314/587] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:27.028488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:27.029451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:27.035689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:27.036125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:27.036922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:27.037348 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:27.065505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3dd96084-1494-4886-807e-87d3ea09cbcc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Oct 28 15:22:27.066053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 274/588] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:28.076465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:28.077369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:28.083603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:28.084048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:28.084847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:28.085276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:28.117254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3aefb392-f67a-45e7-ab06-5d01406d90dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Oct 28 15:22:28.118344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 315/589] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:29.129036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:29.129938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:29.136062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:29.136577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:29.137334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:29.137757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:29.168416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6a563768-316d-4448-b32e-5b0e8e131bb6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Oct 28 15:22:29.168975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 275/590] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:30.180295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:30.181850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:30.188038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:30.188512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:30.189271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:30.189691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:30.217990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-924a030e-c5a5-48c3-b8a5-99a16769702c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Oct 28 15:22:30.218471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 316/591] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:31.228030 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:31.228974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:31.235172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:31.235616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:31.236405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:31.236838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:31.266533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-81aa8860-2ccd-47cc-b3d0-64aa714f2f63 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Oct 28 15:22:31.267088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 276/592] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:32.281339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:32.281339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:32.285337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:32.285775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:32.286526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:32.286942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:32.315730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0cbe5808-2b9e-4648-b69c-4899787ff481 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041927 Oct 28 15:22:32.316251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 317/593] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:33.326796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:33.327700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:33.333627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:33.334068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:33.334834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:33.335260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:33.364630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-313b9396-91db-4a5e-b719-295b922c13ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Oct 28 15:22:33.365186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 277/594] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:34.374930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:34.375952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:34.382408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:34.382788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:34.383537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:34.384577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:34.413188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-de5f7d4a-0910-42d1-8182-72a10989b2f8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041876 Oct 28 15:22:34.413748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 318/595] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:35.423564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:35.424504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:35.431086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:35.431533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:35.432303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:35.432767 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:35.461902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bd424629-6f93-4770-9830-bf4c1cd680a9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Oct 28 15:22:35.463105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 278/596] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:36.473650 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:36.474546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:36.480717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:36.481153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:36.481909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:36.482329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:36.511259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-75601b8d-bdd8-47cd-b8e1-d5a9d5ae842d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Oct 28 15:22:36.514917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 319/597] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:37.522463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:37.523404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:37.529684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:37.530129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:37.530899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:37.531326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:37.560491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c3944d73-3fbb-46fa-a58f-a9f57c05d50c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Oct 28 15:22:37.561044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 279/598] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:38.669174 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:38.670073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:38.675705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:38.676131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:38.676948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:38.677383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:38.706149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c4f02998-fa4b-47ba-9455-8d85e1ead213 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139076 Oct 28 15:22:38.706694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 320/599] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:39.717651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:39.719404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:39.725690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:39.726128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:39.726883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:39.727305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:39.758172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f2f6f8b5-976a-4973-b321-237071b056c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Oct 28 15:22:39.758728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 280/600] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:40.770085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:40.770985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:40.777330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:40.777764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:40.778516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:40.778935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:40.807802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dd1d542e-453c-41a3-b8a3-9033b4dcc385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Oct 28 15:22:40.810272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 321/601] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:41.819079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:41.819986 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:41.826795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:41.827234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:41.827989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:41.828439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:41.855984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-28ee1cf2-575d-4193-bf82-c4a8ba72909a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040712 Oct 28 15:22:41.856560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 281/602] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:42.867251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:42.868068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:42.874261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:42.874697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:42.875444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:42.875867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:42.905277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3cfd03b0-a0dd-40c4-b581-4d904726f787 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Oct 28 15:22:42.905821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 322/603] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:43.916579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:43.917490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:43.923627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:43.924072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:43.924861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:43.925295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:43.953927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ea8cd8c8-0c61-4077-aa4e-7f7ac64574b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Oct 28 15:22:43.954463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 282/604] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:44.965629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:44.966629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:44.972912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:44.973343 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:44.974091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:44.974508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:45.002381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0dbe4299-65e9-4cc8-8709-8d692e55f98f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Oct 28 15:22:45.002843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 323/605] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:46.013555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:46.014444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:46.020879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:46.021329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:46.022089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:46.022519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:46.051183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-eb517e3b-1408-43a2-96ad-3cd35adab32b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041432 Oct 28 15:22:46.051737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 283/606] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:47.062550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:47.063438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:47.069541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:47.069973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:47.070738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:47.071157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:47.099265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9515211f-9acb-4de0-bd68-d39a833bd644 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040586 Oct 28 15:22:47.099804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 324/607] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:48.110346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:48.111396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:48.117673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:48.118121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:48.118912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:48.119338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:48.148346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c55e1f30-cde0-4978-9bb4-731c9eb4e16e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Oct 28 15:22:48.148933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 284/608] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:49.159489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:49.160427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:49.166527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:49.166962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:49.167709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:49.168132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:49.197138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9eabce7-e958-4f06-b518-60e5d34d19ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Oct 28 15:22:49.197712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 325/609] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:50.208856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:50.209758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:50.215962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:50.216433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:50.217231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:50.217661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:50.247166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b59e80d8-22f9-41a9-9a09-de27369917d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Oct 28 15:22:50.247725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 285/610] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:51.258404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:51.259312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:51.265560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:51.266255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:51.267008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:51.267434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:51.295874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-21c70de7-a2fe-4b3c-993f-c9c0939ddd1a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 Oct 28 15:22:51.296432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 326/611] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:52.310545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:52.311992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:52.319054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:52.319500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:52.320301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:52.320817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:52.349459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1475432b-81b3-4200-8fa0-dd3074cc451c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Oct 28 15:22:52.350157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 286/612] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:22:53.359952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:53.360867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:53.366981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:53.367442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:53.368190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:53.368634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:53.397367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14bc6f0b-b500-4be2-97cb-4b3ff968818c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041126 Oct 28 15:22:53.397907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 327/613] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:54.408260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:54.409197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:54.415043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:54.415485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:54.416293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:54.416735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:54.445345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5098b55b-30ae-4ce9-9894-a157fdb35715 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040760 Oct 28 15:22:54.445885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 287/614] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:55.456305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:55.457286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:55.463462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:55.463897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:55.464806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:55.465236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:55.492399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-17a36f4f-312f-4201-9d50-829bf0269097 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039826 Oct 28 15:22:55.492953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 328/615] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:56.504015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:56.505029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:56.511142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:56.511597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:56.512345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:56.512790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:56.542322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c735c344-ea54-4021-9200-bb62ed81f273 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Oct 28 15:22:56.543386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 288/616] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:57.554106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:57.555063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:57.561413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:57.561847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:57.562595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:57.563014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:57.591878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1b0f17b5-2d10-4b7f-9fa1-a053f461e1f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Oct 28 15:22:57.592451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 329/617] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:58.602765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:58.603668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:58.610432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:58.610872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:58.611626 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:58.612054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:58.639723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb692a85-e69d-4b61-b2f2-a8fd83c7507d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 Oct 28 15:22:58.640259 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 289/618] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:22:59.661419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:22:59.662346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:22:59.668624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:59.669059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:59.669822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:22:59.670246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:22:59.698683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-203df764-8945-4d3c-b129-88fe7fb46fbb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Oct 28 15:22:59.699155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 330/619] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:22:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:00.710067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:00.710971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:00.717667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:00.724413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:00.724413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:00.724413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:00.748411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9a229b32-20f6-4197-96b7-dbfa7cf4dde6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 Oct 28 15:23:00.753159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 290/620] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:01.759081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:01.759964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:01.766530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:01.766964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:01.767719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:01.768142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:01.797471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b67b626f-963d-40a0-83c7-634ca872a6a7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Oct 28 15:23:01.797949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 331/621] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:02.809269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:02.810103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:02.816202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:02.816666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:02.817417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:02.817838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:02.845779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-71a157fa-b822-4b0e-a1e1-b46cecd12751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040837 Oct 28 15:23:02.846323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 291/622] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:03.856291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:03.857237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:03.863549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:03.863994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:03.864784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:03.865215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:03.894730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-581bf844-21ef-4be9-a2a6-d2e2f326db36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Oct 28 15:23:03.895198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 332/623] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:04.905431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:04.906351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:04.915170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:04.915965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:04.917383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:04.918676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:04.952536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-83ea371a-e819-4e7a-8838-e653a1a592a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050765 Oct 28 15:23:04.953092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 292/624] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:05.962712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:05.963611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:05.969810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:05.970185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:05.970939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:05.971363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:05.999911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-751c2333-7f4b-4294-becb-0698b52c8a32 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Oct 28 15:23:06.000447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 333/625] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:07.010857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:07.011724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:07.018784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:07.019225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:07.019991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:07.020444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:07.048706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2a66f287-4439-4b10-a73c-aea8e7ad9421 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Oct 28 15:23:07.049248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 293/626] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:08.060696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:08.061994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:08.069760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:08.070223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:08.071051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:08.071479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:08.099561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d4ab73be-bc7c-4b20-b41d-423571611edf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Oct 28 15:23:08.100105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 334/627] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:09.111179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:09.112086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:09.118275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:09.118722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:09.119481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:09.119914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:09.147727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c0524fe4-bb63-4dcb-8a1a-736f2b6317b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 Oct 28 15:23:09.148269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 294/628] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:10.158313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:10.159258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:10.165408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:10.165848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:10.166739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:10.167034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:10.195665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fa51e21a-d007-4582-8cfa-7913d1f1f339 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041100 Oct 28 15:23:10.196206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 335/629] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:11.207431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:11.208334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:11.214535 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:11.214970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:11.215716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:11.216140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:11.245727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3240561f-92a8-4d55-970c-5c0d55579cce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Oct 28 15:23:11.246268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 295/630] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:12.257605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:12.258446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:12.265212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:12.265656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:12.266678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:12.267102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:12.295913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-23b6f340-297b-4af2-9589-2d71e352c5ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042083 Oct 28 15:23:12.299388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 336/631] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:13.309024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:13.309936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:13.317614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:13.317996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:13.318791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:13.319237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:13.350188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8276b7ea-e435-446d-ac1a-d9367ff02db7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Oct 28 15:23:13.350743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 296/632] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:14.362652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:14.363486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:14.369682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:14.370122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:14.370875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:14.371301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:14.399498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f7d8fa92-8b58-436b-bf33-57add3e6b86a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Oct 28 15:23:14.400037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 337/633] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:15.411038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:15.411939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:15.418250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:15.418698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:15.419951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:15.420381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:15.449028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-43f3d198-d1f0-45ed-8f43-becb6ffa712b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Oct 28 15:23:15.449576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 297/634] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:16.460102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:16.461032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:16.467304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:16.467737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:16.468532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:16.468951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:16.496054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5892b281-c938-46f5-8f4f-91b0e2599581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039676 Oct 28 15:23:16.496625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 338/635] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:17.507034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:17.507945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:17.514196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:17.514638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:17.515392 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:17.515820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:17.543737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-980f85ed-e7b8-4a13-8e6d-b1c820de9f77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040375 Oct 28 15:23:17.544799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 298/636] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:18.554939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:18.555849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:18.562558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:18.563001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:18.563764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:18.564194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:18.591446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d32698dc-dd1b-4e9d-9995-4681fb91e698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040320 Oct 28 15:23:18.591984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 339/637] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:19.602641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:19.603473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:19.609673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:19.610114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:19.610901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:19.611330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:19.640255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-24a37af0-5aad-415a-a15b-a0eeb2d280f3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Oct 28 15:23:19.640904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 299/638] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:20.651824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:20.652675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:20.658838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:20.659268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:20.660016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:20.660457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:20.689092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26b2404e-5ce2-45dc-922b-4f64b63124f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Oct 28 15:23:20.689623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 340/639] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:21.700171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:21.701109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:21.707283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:21.707768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:21.708605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:21.709035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:21.738335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7f77e7b0-593d-4090-9a4d-ccd8c894b84c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Oct 28 15:23:21.738887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 300/640] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:22.750302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:22.751342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:22.757560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:22.757995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:22.758750 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:22.759169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:22.787034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6309ae53-d595-4b12-8c10-c73dd0ca59c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041207 Oct 28 15:23:22.787579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 341/641] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:23.798496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:23.799397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:23.805843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:23.806285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:23.807041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:23.807470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:23.835787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-615b5f1b-d160-466c-89e7-5b32870af091 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041181 Oct 28 15:23:23.836378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 301/642] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:24.846973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:24.847912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:24.854258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:24.854698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:24.855453 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:24.855881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:24.883876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e42a3b49-0992-461c-9537-afc633bdf581 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Oct 28 15:23:24.884438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 342/643] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:25.895320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:25.896147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:25.902388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:25.902828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:25.903583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:25.904346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:25.932185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c3dd3a04-61f3-4b77-994f-754f0e7c01e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040908 Oct 28 15:23:25.932751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 302/644] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:26.944118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:26.945080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:26.951939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:26.952373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:26.953144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:26.953568 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:26.980693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-205885ba-99a9-4463-a2f1-5eda79ded1c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040256 Oct 28 15:23:26.981223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 343/645] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:27.991848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:27.992779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:27.999038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:27.999480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:28.000242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:28.000710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:28.029249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8efa608d-97f7-44da-9b67-e965db07de5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Oct 28 15:23:28.029726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 303/646] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:29.041205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:29.042108 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:29.048560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:29.048995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:29.049738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:29.050158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:29.078077 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dbfaf681-47b8-4f20-971a-2788bfff0732 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Oct 28 15:23:29.078624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 344/647] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:30.089868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:30.091363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:30.098776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:30.099220 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:30.099992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:30.100462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:30.131974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-27c0c922-c409-444b-ba56-fc698941aad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Oct 28 15:23:30.132553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 304/648] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:31.145675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:31.146483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:31.152576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:31.153008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:31.153748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:31.154163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:31.197004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3e77d121-c67d-44eb-ab2f-860013895895 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055672 Oct 28 15:23:31.197593 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 345/649] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:32.208764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:32.209670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:32.215809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:32.216246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:32.217119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:32.217548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:32.246780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-37b02fce-7cde-443a-9073-b262fb013f05 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Oct 28 15:23:32.247326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 305/650] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:33.258276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:33.259086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:33.265321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:33.265755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:33.266757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:33.267174 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:33.295623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e318f2c7-bb39-4e1f-b299-35c3c65f0e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Oct 28 15:23:33.296152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 346/651] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:34.306922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:34.307831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:34.314025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:34.314465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:34.316106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:34.316574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:34.344590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c412610c-9c22-4a4c-ac4a-8b6810a19b6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041387 Oct 28 15:23:34.345130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 306/652] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:35.354962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:35.355863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:35.362551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:35.362997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:35.363751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:35.364178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:35.392566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9b0ff755-4f0b-410f-85de-18c1942d0c7a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041300 Oct 28 15:23:35.393127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 347/653] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:36.404215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:36.405070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:36.411853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:36.412328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:36.413112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:36.413543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:36.442347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-21345012-e941-418c-972e-070961994992 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Oct 28 15:23:36.442898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 307/654] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:23:37.453355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:37.454259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:37.461051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:37.461500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:37.462254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:37.462682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:37.490941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e27f6b31-ff50-4243-80b6-b2e53edbc68f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041103 Oct 28 15:23:37.491873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 348/655] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:38.503607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:38.505119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:38.511259 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:38.511704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:38.512494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:38.512929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:38.540649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-588140d8-a610-4d28-9e72-75716e13d4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Oct 28 15:23:38.541196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 308/656] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:39.551806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:39.552739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:39.558927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:39.559370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:39.560123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:39.560589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:39.589016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-95d2d625-c8be-4f42-b941-7878cdf33308 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Oct 28 15:23:39.589553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 349/657] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:40.600884 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:40.601879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:40.608042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:40.608511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:40.609266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:40.609689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:40.651055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7cf49e30-c86d-491d-b54c-1ed20fff8d31 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054069 Oct 28 15:23:40.652026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 309/658] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:41.662945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:41.663756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:41.669996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:41.670433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:41.671180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:41.671605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:41.699344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-046fa58e-2b6b-4a17-96b0-08f256112f55 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040201 Oct 28 15:23:41.699880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 350/659] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:42.710674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:42.711575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:42.717834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:42.718278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:42.719038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:42.719467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:42.748718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-38f1c401-dd51-41ae-8782-24746b2bd27f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 Oct 28 15:23:42.749283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 310/660] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:43.759982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:43.760935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:43.767290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:43.773876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:43.773876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:43.773876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:43.797000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ba792c3f-f981-4e53-a7a9-e8a94d987a36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Oct 28 15:23:43.797541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 351/661] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:44.808324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:44.809185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:44.815311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:44.815749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:44.816532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:44.816961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:44.845215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-66114b6c-7592-48c2-b8ce-945544ee48a6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040722 Oct 28 15:23:44.845775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 311/662] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:45.856481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:45.857380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:45.863587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:45.864023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:45.864796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:45.865846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:45.893977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6f107c31-70d3-4f00-b995-f2f03860a34d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Oct 28 15:23:45.894521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 352/663] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:46.905221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:46.906156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:46.912348 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:46.912822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:46.913645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:46.914014 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:46.941467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-22797a8d-407c-4646-aa15-cd282d82678d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040018 Oct 28 15:23:46.942009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 312/664] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:47.953180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:47.954110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:47.960774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:47.961215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:47.961962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:47.962385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:47.990327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14f2ecdd-12c2-4b96-b555-7544cd3383b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040866 Oct 28 15:23:47.990872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 353/665] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:49.001578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:49.002493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:49.008791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:49.009235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:49.010007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:49.010460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:49.039265 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-62a4d5a2-c7ea-413c-81f8-f1d9f300ceab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Oct 28 15:23:49.039813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 313/666] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:50.050509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:50.051412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:50.058234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:50.058667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:50.059424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:50.059846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:50.088894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-845b34bf-2a84-41b5-9ab0-a1ff6c9f6ad6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Oct 28 15:23:50.089480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 354/667] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:51.100482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:51.101324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:51.107700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:51.108141 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:51.108937 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:51.109366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:51.138701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a71991d0-0542-4791-8e9c-1507f7e7672c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Oct 28 15:23:51.139254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 314/668] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:52.151050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:52.151961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:52.158934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:52.159413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:52.160183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:52.160644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:52.188529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-94b57280-86dc-4fe9-a5d8-632262649a19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Oct 28 15:23:52.189079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 355/669] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:53.199295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:53.200204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:53.206428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:53.206869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:53.207624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:53.208048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:53.236646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e5fb42ef-e042-4ea7-bb8e-2b98e36d0ba3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Oct 28 15:23:53.237186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 315/670] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:54.248366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:54.249328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:54.255510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:54.255952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:54.256729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:54.257155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:54.284655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-95ee587c-3544-4906-a585-ad3300f80311 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039961 Oct 28 15:23:54.285191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 356/671] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:55.295399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:55.296320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:55.302179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:55.302612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:55.303356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:55.303778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:55.330946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-56817443-4b52-4f85-986e-f6f791eba8b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039241 Oct 28 15:23:55.331474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 316/672] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:56.342879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:56.343753 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:56.349889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:56.350331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:56.351083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:56.351508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:56.378673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-19082dd0-34b6-4add-9569-44381ef6cac1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039638 Oct 28 15:23:56.379205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 357/673] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:57.389866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:57.390740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:57.397304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:57.397749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:57.398510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:57.398941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:57.428968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8b66334a-a349-4e7d-b9c9-add476167979 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Oct 28 15:23:57.429514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 317/674] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:58.441254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:58.442150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:58.448584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:58.449017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:58.449760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:58.450182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:58.477594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-27a74b83-5308-4af8-a893-c4f0fec50196 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040045 Oct 28 15:23:58.478132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 358/675] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:23:59.488806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:23:59.489748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:23:59.495878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:59.496318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:59.497106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:23:59.497534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:23:59.526502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2f548edd-9915-40bd-8c65-765ad37d2f5b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Oct 28 15:23:59.527039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 318/676] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:23:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:00.537777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:00.538675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:00.545381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:00.545811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:00.546720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:00.547160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:00.576450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-abaef1e1-3d8d-4826-bd43-400f30a080c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Oct 28 15:24:00.577003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 359/677] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:01.586996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:01.587909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:01.594205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:01.594650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:01.595423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:01.595855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:01.625038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-605a451c-a148-4de3-9ba8-b45cfc8701c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Oct 28 15:24:01.625582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 319/678] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:02.636246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:02.637667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:02.644192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:02.644679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:02.645441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:02.645916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:02.673657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b41bdea7-95a1-4c09-86cb-fb2114808015 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Oct 28 15:24:02.674194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 360/679] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:03.684686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:03.685590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:03.691998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:03.692454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:03.693222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:03.693656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:03.722486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3d2d5211-7253-4c04-9f43-31bbe7160e44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Oct 28 15:24:03.723034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 320/680] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:04.733885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:04.734792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:04.741229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:04.741707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:04.742679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:04.742887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:04.772985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1d34d022-4a3b-460e-94b3-7a53ac1f72f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Oct 28 15:24:04.773474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 361/681] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:05.784140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:05.785065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:05.791154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:05.791589 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:05.792380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:05.792914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:05.821603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d15ce29e-ddf0-406c-b281-74efa84cafc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041127 Oct 28 15:24:05.822147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 321/682] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:06.833383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:06.834198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:06.840999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:06.841430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:06.842189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:06.842598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:06.870428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8af4c079-ac4d-43ae-b2a0-b2c32d3abd27 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040814 Oct 28 15:24:06.870965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 362/683] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:07.881735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:07.882643 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:07.889524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:07.889970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:07.890736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:07.891177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:07.918978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-88c574e4-04e6-46d1-a04c-dddd98107c86 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Oct 28 15:24:07.919533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 322/684] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:08.930366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:08.931290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:08.937586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:08.938026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:08.938781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:08.939208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:08.967739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0b52c61e-aaae-4beb-8c53-2bee65714d2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Oct 28 15:24:08.968276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 363/685] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:09.979119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:09.980047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:09.986831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:09.987262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:09.988011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:09.988457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:10.017590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b8a5d508-94c6-42a3-ba25-a5c310858d4a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041120 Oct 28 15:24:10.017590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 323/686] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:11.027558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:11.028407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:11.034847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:11.035298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:11.036051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:11.036510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:11.064940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b737e576-eb28-4722-b6cc-ce3e35879aa1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Oct 28 15:24:11.065483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 364/687] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:12.076058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:12.077499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:12.083987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:12.084465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:12.085234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:12.085663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:12.113802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4575b9b1-0fc7-4e57-8b50-f929f8185530 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Oct 28 15:24:12.114343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 324/688] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:13.125472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:13.126378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:13.132565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:13.133013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:13.133763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:13.134189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:13.162687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-75e7ae4e-3da4-4b84-979e-4fd34f83b6a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Oct 28 15:24:13.163222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 365/689] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:13.406707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:24:13.407206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:24:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:24:14.173594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:14.174512 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:14.180745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:14.181190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:14.181951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:14.182380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:14.211922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5decaec8-fc20-491f-b821-53a192542d35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Oct 28 15:24:14.212484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 325/690] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:15.223289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:15.224276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:15.230463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:15.230902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:15.231658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:15.232080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:15.260740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c1ace5f4-380e-4f47-a16a-d6f1c1c8e95c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Oct 28 15:24:15.261289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 366/691] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:16.271842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:16.272815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:16.278969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:16.279409 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:16.280163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:16.280623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:16.309040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c521181f-4ddd-4ca7-9690-b7f0795cfc35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Oct 28 15:24:16.309573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 326/692] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:17.320060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:17.321006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:17.327225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:17.327669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:17.328451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:17.328883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:17.356438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3797584e-1579-4b37-9a87-cb71d889e404 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040112 Oct 28 15:24:17.356981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 367/693] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:18.367669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:18.368539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:18.374755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:18.375199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:18.376529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:18.376965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:18.405295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6a8db7e0-f383-4c10-8ae9-cc767317bdd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Oct 28 15:24:18.405835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 327/694] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:19.416579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:19.417484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:19.423643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:19.424076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:19.424866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:19.425284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:19.452469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ede2401b-a743-4948-b188-0105c8d8b3a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039789 Oct 28 15:24:19.452998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 368/695] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:20.194644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:24:20.194821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:24:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:24:20.464867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:20.465705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:20.472673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:20.473116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:20.473880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:20.474310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:20.502094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-82495f4d-e464-40dd-851e-49ac5ba770b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 Oct 28 15:24:20.502628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 328/696] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:24:20.557377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:24:20.557510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:24:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:24:21.513451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:21.514345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:21.521574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:21.522015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:21.522762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:21.523180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:21.551145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a7448452-f670-4058-8b1b-d33af7ef85b3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Oct 28 15:24:21.551676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 369/697] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:22.562369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:22.563763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:22.570083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:22.570558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:22.571321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:22.571753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:22.601828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8369e3be-abda-4aa0-b42c-cc028db59c30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Oct 28 15:24:22.602380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 329/698] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:23.614431 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:23.615252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:23.620927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:23.621442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:23.622202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:23.622629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:23.650775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4ca92050-fe88-45aa-8189-b2c92095f808 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041568 Oct 28 15:24:23.651310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 370/699] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:24.662098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:24.663053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:24.668823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:24.669258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:24.670003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:24.670425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:24.697831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-81154790-d5c1-42c4-bd50-27402c7c3a44 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039647 Oct 28 15:24:24.698365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 330/700] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:25.709238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:25.710145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:25.716287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:25.716749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:25.717496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:25.717915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:25.747657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-45670dc8-28cc-457f-a30c-a275acee8313 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Oct 28 15:24:25.748211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 371/701] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:26.758819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:26.759743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:26.765969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:26.767083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:26.768083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:26.768531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:26.795745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e95e6ab0-85b4-45da-8744-71b93968d85d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Oct 28 15:24:26.796276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 331/702] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:27.806801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:27.807722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:27.814556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:27.814989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:27.815736 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:27.816153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:27.844273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fe3971bb-b4d9-428a-ba35-476e1798d4c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Oct 28 15:24:27.844836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 372/703] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:28.855588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:28.856461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:28.862710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:28.863154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:28.863915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:28.864346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:28.893101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8af5e8ac-73ac-404e-9c15-4bd1e32a1ed1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041292 Oct 28 15:24:28.893634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 332/704] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:29.904351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:29.905278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:29.911962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:29.912410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:29.913290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:29.913710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:29.941357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-877774f9-e1b3-44b1-a4d5-4d200000df83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040778 Oct 28 15:24:29.941899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 373/705] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:30.952672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:30.953597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:30.959689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:30.960128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:30.960928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:30.961352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:30.990505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-78ac0ea0-e890-4bc1-a97c-a7e4a9b1dbd4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041679 Oct 28 15:24:30.991051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 333/706] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:32.002192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:32.002997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:32.009380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:32.009809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:32.010558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:32.011004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:32.041440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-af84428f-539e-49d9-8aa3-08ced20c6ebf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Oct 28 15:24:32.042107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 374/707] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:33.053564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:33.054368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:33.060621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:33.061063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:33.061808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:33.062230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:33.090079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-485f4cda-2222-4f5f-b168-5a67c264c8ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040313 Oct 28 15:24:33.090608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 334/708] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:34.101210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:34.102031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:34.108300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:34.108777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:34.109532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:34.109958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:34.143447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a17d7a47-1192-414c-ae02-6b0543edf14a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Oct 28 15:24:34.143993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 375/709] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:35.155133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:35.156032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:35.162785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:35.163225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:35.163982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:35.164434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:35.191606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-87030f21-c266-41fa-8293-1307dadd2367 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040535 Oct 28 15:24:35.192133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 335/710] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:24:36.202630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:36.203551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:36.210321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:36.210758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:36.211506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:36.211924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:36.239416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a0757ca3-c845-406d-981e-fd39be709c68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 Oct 28 15:24:36.239955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 376/711] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:37.251106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:37.252023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:37.258227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:37.258666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:37.259423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:37.259849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:37.288294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f7e9c054-be2d-47da-b69e-6b34f49fe819 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Oct 28 15:24:37.288871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 336/712] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:38.300093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:38.301044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:38.307295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:38.307742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:38.308529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:38.308954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:38.337247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-31cfc74b-38ef-452a-b043-e954d3859b3a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Oct 28 15:24:38.337796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 377/713] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:39.348565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:39.349505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:39.355595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:39.356033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:39.356820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:39.357247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:39.385377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-638d37f2-ec55-4663-b2a9-90c8c3f30e08 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040527 Oct 28 15:24:39.385913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 337/714] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:40.396797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:40.397700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:40.403878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:40.404319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:40.405107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:40.405533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:40.433412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-02869988-96dd-4589-b058-4f315a0bf0a0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040684 Oct 28 15:24:40.433951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 378/715] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:41.445152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:41.446078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:41.452195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:41.452661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:41.453446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:41.453886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:41.481780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-17fde816-2a91-493b-ba19-80c9686f9b77 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040354 Oct 28 15:24:41.482311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 338/716] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:42.494361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:42.495263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:42.502031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:42.502469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:42.503230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:42.503655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:42.534082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9bfd4fcf-5b4c-43c4-90ac-efd46a136e30 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Oct 28 15:24:42.534626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 379/717] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:43.303500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:24:43.303724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:24:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:24:43.545491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:43.546433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:43.552726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:43.553171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:43.553991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:43.554367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:43.582914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ab00f82b-6c3a-4c8c-a20e-c0d1a18ad5a1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 Oct 28 15:24:43.583454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 339/718] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:44.594594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:44.595511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:44.601741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:44.602175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:44.602917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:44.603331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:44.631998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-32df87a1-f6cc-49c3-8459-df8952de2136 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041555 Oct 28 15:24:44.632562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 380/719] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:45.643236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:45.644457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:45.650629 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:45.651078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:45.651845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:45.652276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:45.681874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-605bc1ef-395f-41ab-84c8-6a8dcd448202 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Oct 28 15:24:45.685697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 340/720] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:46.692918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:46.693818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:46.700011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:46.700491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:46.701252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:46.701682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:46.729805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a63e7052-8510-498e-b410-ed8149cb4710 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040912 Oct 28 15:24:46.730359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 381/721] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:47.741282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:47.742193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:47.748492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:47.748939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:47.749704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:47.750135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:47.780068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-32ca2fb2-206b-442e-9cd3-60d7dcf5bb8f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 Oct 28 15:24:47.780671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 341/722] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:48.791945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:48.792878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:48.799202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:48.799808 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:48.800613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:48.801038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:48.829085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-25612139-89b4-4faa-9e93-4cd219a2a95f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040922 Oct 28 15:24:48.830091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 382/723] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:49.840799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:49.841735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:49.848703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:49.849146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:49.849909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:49.850339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:49.879085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fac461bc-c25a-476d-95e2-970d9e86f6b8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Oct 28 15:24:49.879635 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 342/724] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:50.890649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:50.891601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:50.898387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:50.898802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:50.899557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:50.899979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:50.929356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9428f50c-c44a-4a46-84db-ed6b2376ffc2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042590 Oct 28 15:24:50.929917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 383/725] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:51.939641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:51.940578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:51.946747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:51.947186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:51.947936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:51.948362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:51.977088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d0e7a29d-cf2d-4af2-aa7e-95beb3bb021c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Oct 28 15:24:51.977641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 343/726] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:52.988847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:52.989756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:52.995890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:52.996436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:52.997207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:52.997635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:53.026518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bcc95b3f-d62f-47a7-a712-5a48dab354e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Oct 28 15:24:53.027073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 384/727] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:54.037924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:54.038740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:54.044715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:54.045162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:54.045923 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:54.046351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:54.075140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b4a0ec62-9879-43f1-8046-bc3c1fc57467 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040975 Oct 28 15:24:54.075691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 344/728] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:24:55.086790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:55.087608 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:55.094040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:55.094482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:55.095382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:55.096312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:55.124146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f99d9989-ec4a-4d0a-b8ca-34fce27ff348 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041157 Oct 28 15:24:55.124734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 385/729] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:56.002849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:24:56.003040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:24:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:24:56.135190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:56.136090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:56.142905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:56.143354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:56.144120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:56.144576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:56.172983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e81bb142-f614-474f-9215-542f7f670ce3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Oct 28 15:24:56.173536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 345/730] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:57.184333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:57.185124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:57.191811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:57.192252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:57.193037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:57.193464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:57.222211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9eb2a35a-0123-413c-8379-2d01ca560a87 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Oct 28 15:24:57.222744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 386/731] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:58.233630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:58.234534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:58.240136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:58.240629 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:58.241397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:58.241829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:58.271322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-67582f34-174a-427a-8e6d-7bf02c338ab7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Oct 28 15:24:58.271869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 346/732] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:24:59.282295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:24:59.283246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:24:59.289592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:59.290035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:59.290796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:24:59.291231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:24:59.319669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8f0657d8-4895-4452-9541-fce33b128888 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 Oct 28 15:24:59.320201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 387/733] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:24:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:00.330658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:00.331663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:00.337843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:00.338292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:00.339060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:00.339490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:00.368171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1565b678-66ea-4418-a59c-fc493f17b96e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Oct 28 15:25:00.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 347/734] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:01.378873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:01.379834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:01.386284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:01.386730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:01.387594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:01.388070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:01.418180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f2ade800-c186-43d9-841c-288768fa21c7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Oct 28 15:25:01.419429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 388/735] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:02.429775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:02.430713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:02.436860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:02.437306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:02.438068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:02.438481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:02.477948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1a1b559a-1ee2-423a-88c3-069fad055972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051881 Oct 28 15:25:02.478499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 348/736] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:03.491208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:03.492153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:03.499122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:03.499587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:03.500338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:03.500816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:03.529500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-53c1997b-b3e1-455e-9d4f-16eef7e643cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Oct 28 15:25:03.530042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 389/737] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:04.541301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:04.542205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:04.548318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:04.548794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:04.549544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:04.549971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:04.578209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-937835ba-93d0-486f-aa87-fda389dddfce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Oct 28 15:25:04.578742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 349/738] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:05.589022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:05.589934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:05.596071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:05.596540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:05.597287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:05.598340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:05.626491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-61f2d954-7059-4b52-bd84-637d2b382f3d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Oct 28 15:25:05.627043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 390/739] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:06.637312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:06.638221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:06.644783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:06.645282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:06.646052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:06.646488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:06.675003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b1d26fdc-b0f5-43e6-8c14-2d063f6506e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Oct 28 15:25:06.675570 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 350/740] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:07.685823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:07.686721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:07.693254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:07.693689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:07.694434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:07.694854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:07.723156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4d0aca50-a180-4df3-9b96-d805dcb9b349 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040430 Oct 28 15:25:07.723682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 391/741] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:08.733826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:08.738827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:08.741084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:08.741604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:08.742402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:08.743082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:08.773059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3731df3e-6d8c-4919-b658-c0a9c95e2401 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042881 Oct 28 15:25:08.773609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 351/742] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:09.784277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:09.785892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:09.792063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:09.792543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:09.793304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:09.793733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:09.821445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-66d8447e-5edf-4f31-a831-acb8e88bb758 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 Oct 28 15:25:09.822633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 392/743] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:10.832536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:10.833445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:10.839549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:10.839999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:10.840795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:10.841230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:10.870668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-227b02ad-c364-4d5a-b15a-3b304697df5a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Oct 28 15:25:10.871262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 352/744] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:11.882352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:11.883280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:11.889455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:11.889892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:11.890644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:11.891064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:11.924511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9726942d-7fcd-4243-a51d-43280d14e700 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Oct 28 15:25:11.925141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 393/745] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:12.936500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:12.937406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:12.944284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:12.944757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:12.945510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:12.946132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:12.984234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-da9b31d2-d285-4495-8e90-afeb80cce001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051484 Oct 28 15:25:12.985100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 353/746] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:13.996756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:13.997594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:14.003744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:14.004188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:14.004980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:14.005410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:14.034465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ce8a2439-44f9-450c-bfbc-7e9869a9fcbd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Oct 28 15:25:14.035507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 394/747] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:15.046173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:15.047085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:15.053277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:15.053721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:15.054484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:15.054915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:15.082952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-29a70843-6de3-476e-8e9c-6de0c96bdcf7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Oct 28 15:25:15.083485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 354/748] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:16.093293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:16.094187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:16.100993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:16.101425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:16.102167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:16.102586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:16.130351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f20f7df3-db81-4645-84d5-9dfa75f4d784 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040780 Oct 28 15:25:16.130878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 395/749] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:17.141414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:17.142408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:17.149442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:17.149886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:17.150668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:17.151105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:17.179283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3c669fc8-326b-4e25-8fae-e2040bf163f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Oct 28 15:25:17.179823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 355/750] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:18.190513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:18.192005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:18.198113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:18.198549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:18.199301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:18.199724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:18.227560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60203a8b-13b3-418d-9b96-0ae3650072ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 Oct 28 15:25:18.228095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 396/751] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:19.239356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:19.240278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:19.246553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:19.247000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:19.247760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:19.248192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:19.276500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1060d3fa-d1da-4133-a191-f5c7e0201e94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Oct 28 15:25:19.277072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 356/752] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:20.287694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:20.288639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:20.297318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:20.298126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:20.299488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:20.300797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:20.334943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-594e8c93-ded8-4987-b2dc-d8dddd6c18df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050937 Oct 28 15:25:20.335489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 397/753] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:21.346139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:21.347044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:21.353862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:21.354296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:21.355080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:21.355502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:21.383833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fcd2c911-858a-42bb-9589-9ce608a0e1af tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041443 Oct 28 15:25:21.384431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 357/754] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:22.395908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:22.396836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:22.402956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:22.403392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:22.404145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:22.404601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:22.432571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-249cb44a-735d-416d-adf2-7d085ef6841d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Oct 28 15:25:22.433102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 398/755] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:23.443354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:23.444263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:23.450423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:23.450869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:23.451630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:23.452061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:23.481046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aa8c3996-be74-4d41-b004-da13d6067920 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Oct 28 15:25:23.481582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 358/756] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:24.492534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:24.493442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:24.499594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:24.500036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:24.500824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:24.501251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:24.530216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0c9e75ac-00bf-4b8d-9d31-b18bd2d5c96b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Oct 28 15:25:24.530751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 399/757] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:25.541568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:25.542470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:25.548407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:25.548856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:25.549616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:25.550049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:25.577627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f429f7bd-8379-457c-a3e1-7c68f9eb59fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039784 Oct 28 15:25:25.578165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 359/758] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:26.589720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:26.590617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:26.596783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:26.597721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:26.598474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:26.598892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:26.627982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9b71f872-a442-4c95-b8e8-ea3eb8c225ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Oct 28 15:25:26.628582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 400/759] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:27.639223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:27.640119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:27.647123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:27.647565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:27.648317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:27.648773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:27.676624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e81682a3-e2e7-4151-93eb-d8e68c942228 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Oct 28 15:25:27.677162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 360/760] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:28.687603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:28.688538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:28.695216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:28.695679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:28.696451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:28.696873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:28.724187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2ebe53dd-f9ca-4b7f-992d-8357efea21ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040326 Oct 28 15:25:28.724754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 401/761] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:29.735075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:29.735977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:29.742431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:29.752233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:29.752233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:29.752233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:29.773622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a8b3c71b-d2ab-41a3-a0a2-626e67d96076 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Oct 28 15:25:29.774213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 361/762] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:30.785740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:30.786770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:30.793216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:30.793665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:30.794424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:30.794853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:30.822543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a540d1d9-5d2c-46db-98af-0bab90538ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041167 Oct 28 15:25:30.823084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 402/763] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:31.834316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:31.835212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:31.841307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:31.841740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:31.842682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:31.842924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:31.871531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-980e1ec3-788f-4866-ad75-4106f507a830 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041529 Oct 28 15:25:31.872060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 362/764] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:32.882481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:32.883408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:32.889771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:32.890213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:32.890977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:32.891433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:32.920581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d5614720-bc09-4dc5-b1c9-9fdc8d97a8ed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041963 Oct 28 15:25:32.921129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 403/765] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:33.930853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:33.931743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:33.937864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:33.938299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:33.939040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:33.939517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:33.967503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0497226c-3342-44f6-be6d-b78001319ce7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040388 Oct 28 15:25:33.968034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 363/766] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:34.978598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:34.979508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:34.985738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:34.986180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:34.986934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:34.987961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:35.015330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fb0e32cb-62cb-4426-bab8-cd8770a747b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040472 Oct 28 15:25:35.015866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 404/767] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:36.026640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:36.027467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:36.033586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:36.034022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:36.034773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:36.035195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:36.062842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4dcd132d-eee4-4978-b445-e78a40a81069 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039983 Oct 28 15:25:36.063375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 364/768] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:37.074416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:37.075306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:37.081420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:37.081861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:37.082614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:37.083041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:37.111119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e35e6d96-b91a-427e-89f7-fee5466bc705 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 Oct 28 15:25:37.111652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 405/769] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:38.122939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:38.123812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:38.129969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:38.130414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:38.131176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:38.131610 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:38.161359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-93cd608a-f812-41da-aefd-63b0c44c5c8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Oct 28 15:25:38.162192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 365/770] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:39.173827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:39.174773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:39.181348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:39.182081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:39.182860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:39.183284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:39.215173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e58f6ccd-a778-4021-8aee-dd016942c649 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Oct 28 15:25:39.215726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 406/771] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:40.227024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:40.227928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:40.234113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:40.234551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:40.235310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:40.235737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:40.263893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c5d2691f-9c02-4e91-b267-5d94c13f7afd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040686 Oct 28 15:25:40.264453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 366/772] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:41.275040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:41.276026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:41.282080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:41.282541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:41.283291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:41.283713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:41.311213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9c955d42-d571-4b9a-9140-23392c7b24f1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039951 Oct 28 15:25:41.311735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 407/773] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:42.322613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:42.323520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:42.329692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:42.330137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:42.331469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:42.331904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:42.359702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6ab739f9-8668-449c-9d87-44b78c7e7e02 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040924 Oct 28 15:25:42.360240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 367/774] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:43.370570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:43.371513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:43.378528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:43.378990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:43.379784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:43.380209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:43.408818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d071c164-f8b5-4041-ba0b-e6fc97c3c672 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Oct 28 15:25:43.409856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 408/775] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:44.420796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:44.421703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:44.428633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:44.429081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:44.429848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:44.430276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:44.458273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-562b2f36-f42c-4fa4-a35b-e9d848098fc4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041202 Oct 28 15:25:44.458806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 368/776] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:45.469505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:45.470407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:45.477000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:45.477443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:45.478192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:45.478614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:45.506537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-81fa55b0-5320-4029-9bcf-f62712e7196a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Oct 28 15:25:45.507071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 409/777] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:46.518202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:46.519091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:46.525826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:46.526266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:46.527028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:46.527452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:46.560639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-75128d8e-f032-4d27-a8e5-843c3bf52b04 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Oct 28 15:25:46.561219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 369/778] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:47.571363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:47.572267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:47.578449 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:47.578888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:47.579641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:47.580067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:47.608184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-36277988-4de3-4c4f-94bc-633a1c2b902c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040590 Oct 28 15:25:47.608756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 410/779] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:48.619685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:48.620634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:48.627606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:48.628050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:48.628872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:48.629303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:48.668072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2c468d38-8eb1-408f-aa85-eae423ede3db tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052183 Oct 28 15:25:48.668662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 370/780] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:49.679841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:49.680798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:49.687547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:49.688011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:49.688791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:49.689213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:49.717921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f7f7f413-3b4e-4807-a767-4dd32bdac6ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Oct 28 15:25:49.718389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 411/781] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:50.728679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:50.729590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:50.735840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:50.736280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:50.738873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:50.738873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:50.767022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c10a4f1b-52c7-46dd-9675-60276377df3c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 Oct 28 15:25:50.767452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 371/782] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:51.779153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:51.782149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:51.787199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:51.787637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:51.788410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:51.788842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:51.817560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e616c4ab-037a-4571-a20d-d503238abbc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Oct 28 15:25:51.818024 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 412/783] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:52.829042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:52.829955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:52.836119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:52.836611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:52.837375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:52.837804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:52.866865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4cb66923-f4f4-4241-bf02-c2696a1a470b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 Oct 28 15:25:52.867333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 372/784] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:53.878150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:53.879238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:53.885434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:53.885870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:53.886609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:53.887028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:53.916325 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c47f3b1-287a-4fc9-add9-c8d832b012b5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041950 Oct 28 15:25:53.916826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 413/785] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:54.927570 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:54.928501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:54.934576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:54.935012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:54.935904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:54.936339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:54.965382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-881b326c-f8b2-4726-804c-173ce6409f94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Oct 28 15:25:54.965925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 373/786] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:55.977155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:55.978084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:55.984200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:55.984678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:55.985427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:55.985850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:56.014116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c348c79-e19c-408b-9ac9-ec017ce9bfd1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040605 Oct 28 15:25:56.014580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 414/787] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:25:57.025362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:57.026961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:57.033480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:57.033917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:57.035349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:57.035935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:57.065798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-27f290df-a5a5-4070-b15a-2c9f53948200 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Oct 28 15:25:57.066346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 374/788] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:58.077122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:58.077947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:58.083705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:58.084162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:58.084939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:58.085363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:58.114121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b08b4bf7-5113-4685-b316-2fbe15803f0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Oct 28 15:25:58.114654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 415/789] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:25:59.125184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:25:59.126085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:25:59.132985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:59.133368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:59.134121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:25:59.134546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:25:59.172755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aec54e58-1d6d-4198-a81a-4c3ab4c03e46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051213 Oct 28 15:25:59.173302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 375/790] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:25:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:00.184469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:00.185376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:00.191532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:00.191978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:00.192804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:00.193245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:00.221950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c6cd071b-e1d7-4c1e-a6b6-2228466a18bc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Oct 28 15:26:00.223162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 416/791] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:01.234330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:01.235227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:01.241929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:01.242363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:01.243111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:01.243534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:01.273256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ca80df7c-a404-4ad1-b8dc-b8e5e1ee9d36 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Oct 28 15:26:01.273256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 376/792] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:02.282941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:02.283757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:02.289970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:02.292157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:02.292157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:02.292157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:02.320895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-61a8b28c-d717-44c8-a81e-41eba4765074 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041659 Oct 28 15:26:02.321454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 417/793] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:03.332846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:03.333665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:03.339775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:03.340213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:03.341000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:03.341424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:03.371145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-de138652-4bb0-443d-84f1-6b705217cff9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Oct 28 15:26:03.371892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 377/794] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:26:04.384039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:04.384894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:04.391029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:04.391470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:04.392217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:04.392672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:04.423398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-085904fa-999c-4b3d-842d-6167f95a4d26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Oct 28 15:26:04.423964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 418/795] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:05.435316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:05.436205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:05.443045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:05.443478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:05.444229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:05.444672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:05.473446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-02fdcfd2-9c5e-464c-ba63-bc40399b62ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Oct 28 15:26:05.474003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 378/796] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:06.484842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:06.485664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:06.491727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:06.492177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:06.492962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:06.493393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:06.523038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7bda1931-23e5-4b92-91a4-c8f5a249b09c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042002 Oct 28 15:26:06.523758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 419/797] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:07.534310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:07.535150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:07.542187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:07.542604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:07.543317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:07.543744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:07.571942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3979d67b-df7d-4335-b760-ffed62fd5433 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Oct 28 15:26:07.575679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 379/798] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:08.582908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:08.583721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:08.589885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:08.590315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:08.591063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:08.591479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:08.620657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5d6d1ce9-82d8-4c10-9bd3-ba3566099e93 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041388 Oct 28 15:26:08.621350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 420/799] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:09.631748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:09.632657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:09.639177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:09.639657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:09.640444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:09.641062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:09.669377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8035ca59-5d75-4a6f-ad0a-079dafc005ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Oct 28 15:26:09.669930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 380/800] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:10.680631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:10.681532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:10.688402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:10.688864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:10.689627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:10.690051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:10.719137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f1d5eaaa-0672-4f54-acc0-1dc32bc6e491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042171 Oct 28 15:26:10.719695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 421/801] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:11.730117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:11.730942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:11.737098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:11.740153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:11.740153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:11.740153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:11.768719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5838883c-2743-41f3-baf2-404a375723c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Oct 28 15:26:11.769264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 381/802] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:12.779997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:12.780934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:12.787074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:12.787511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:12.788265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:12.788723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:12.816657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dc75610e-e90c-4203-be74-9c2e1309523f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040383 Oct 28 15:26:12.817201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 422/803] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:13.828647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:13.829488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:13.836089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:13.836579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:13.837341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:13.837769 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:13.866503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f5513058-b7ac-4576-be13-f8937a78fc71 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 Oct 28 15:26:13.867042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 382/804] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:14.877862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:14.878681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:14.885005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:14.885445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:14.886355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:14.890562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:14.919941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-010a357e-02ab-4571-91fd-eac54523e211 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Oct 28 15:26:14.920501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 423/805] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:15.931662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:15.932615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:15.939224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:15.939666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:15.940450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:15.940883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:15.969255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3c17fd0e-df33-4df8-ada3-ad413901378e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041358 Oct 28 15:26:15.969795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 383/806] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:16.980356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:16.981286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:16.987379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:16.987820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:16.988615 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:16.989047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:17.016730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-acf90809-6147-4132-a9ba-b7fa1c13f1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040135 Oct 28 15:26:17.017273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 424/807] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:18.028755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:18.029662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:18.035891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:18.036336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:18.037130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:18.037565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:18.066902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-29c420e3-c496-4542-a334-829dee539ef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 Oct 28 15:26:18.068027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 384/808] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:19.078972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:19.079877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:19.087399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:19.087854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:19.088658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:19.089088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:19.119380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2e0b104f-20d1-42ea-8e8c-70ec282cd3b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Oct 28 15:26:19.119962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 425/809] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:20.130784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:20.131604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:20.137775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:20.139000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:20.139000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:20.139359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:20.167929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9246c61c-5a7e-4333-891b-7a28a1392c62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Oct 28 15:26:20.168495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 385/810] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:21.179768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:21.180695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:21.187019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:21.187441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:21.188193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:21.188646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:21.216558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b2fce1c2-bc27-452d-86f8-2e8753afbe14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 Oct 28 15:26:21.217091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 426/811] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:22.228526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:22.229434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:22.235580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:22.236024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:22.236822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:22.237251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:22.265396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d12a5a75-ffef-4413-8756-bca5419517cb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040681 Oct 28 15:26:22.265930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 386/812] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:23.277430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:23.278272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:23.284411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:23.284865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:23.285619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:23.286614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:23.313748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2ce731a3-dee5-4eb6-87f2-c128000c4fcd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040265 Oct 28 15:26:23.315103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 427/813] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:24.324877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:24.325687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:24.331602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:24.332035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:24.332817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:24.333242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:24.360732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-11285f5e-9518-4b47-b4d8-e85080fe2bf9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039624 Oct 28 15:26:24.361268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 387/814] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:25.372644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:25.373467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:25.380209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:25.380667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:25.381410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:25.381834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:25.410121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-06e0fe78-8c32-4976-a846-43d4d2694a2b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041356 Oct 28 15:26:25.410623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 428/815] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:26.421488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:26.422432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:26.428415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:26.434549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:26.434549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:26.434549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:26.459227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8c0f2075-1755-4906-8ef5-bd53cee5489f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040919 Oct 28 15:26:26.459777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 388/816] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:26:27.470543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:27.471442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:27.478073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:27.478517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:27.479271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:27.479750 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:27.508199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-48bf8cce-dadc-49ee-95cd-a004070ef626 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Oct 28 15:26:27.508777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 429/817] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:28.519777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:28.520699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:28.526982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:28.527444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:28.528197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:28.528647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:28.558413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-11b4d2e8-02b2-4629-a573-d0c423f410ba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042668 Oct 28 15:26:28.558967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 389/818] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:29.570304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:29.571113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:29.576872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:29.577305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:29.578046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:29.578461 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:29.607438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-43b6f015-38a7-456b-9735-e7bf22696923 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Oct 28 15:26:29.608000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 430/819] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:30.618723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:30.619569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:30.625823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:30.626264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:30.627060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:30.627488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:30.656296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ff4c22cd-769f-4628-b086-260f9475fc07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041405 Oct 28 15:26:30.656885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 390/820] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:31.667045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:31.668057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:31.674463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:31.675094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:31.675855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:31.676286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:31.705362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b421085a-f6bb-4d18-b759-b6bb40569856 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Oct 28 15:26:31.705920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 431/821] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:32.716699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:32.717605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:32.723839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:32.724284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:32.725079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:32.725505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:32.755696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-614ce8a6-2e5a-4f97-95cb-8fe0ff2f059b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042708 Oct 28 15:26:32.756489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 391/822] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:33.766955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:33.767854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:33.774629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:33.775072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:33.775835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:33.776261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:33.805340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-80c0ff7e-debf-4a30-940a-13deb0ef206a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Oct 28 15:26:33.806041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 432/823] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:34.816961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:34.817868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:34.824942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:34.825384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:34.826221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:34.826642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:34.855950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-012d1cb0-3796-431b-8d99-d22658700f2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Oct 28 15:26:34.856524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 392/824] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:35.866798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:35.867739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:35.873995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:35.874428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:35.875184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:35.875610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:35.908287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1ad8b9c2-a4a5-46f8-908a-770bbe67760f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Oct 28 15:26:35.908885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 433/825] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:36.919332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:36.920278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:36.926492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:36.926914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:36.927682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:36.928115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:36.958176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0eb15188-0743-4b9e-8f0e-8949d3abb8b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Oct 28 15:26:36.958731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 393/826] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:37.968935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:37.969840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:37.976488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:37.976952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:37.977710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:37.978139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:38.008183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60c8ff84-253a-4d3f-a575-cdc8a7c34aa8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Oct 28 15:26:38.008785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 434/827] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:39.019011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:39.019951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:39.026065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:39.026507 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:39.027273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:39.027702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:39.056350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-14fa4160-36ea-4a3f-b3aa-49da6e198224 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041262 Oct 28 15:26:39.056918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 394/828] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:40.068262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:40.070868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:40.078921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:40.080494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:40.081564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:40.082347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:40.118009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-57488cfa-877b-4c75-afe5-0db760706cab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054430 Oct 28 15:26:40.118558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 435/829] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:41.131050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:41.131050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:41.143388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:41.143834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:41.148810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:41.149345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:41.184120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0944fbe8-b277-439d-9918-dfb8e3549d68 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058624 Oct 28 15:26:41.184726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 395/830] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:42.195275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:42.196177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:42.202292 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:42.202735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:42.203539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:42.203965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:42.232484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-044bb51c-3b83-49e4-b5bf-63d3de9ae7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Oct 28 15:26:42.233034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 436/831] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:43.243550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:43.244532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:43.250983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:43.251433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:43.252203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:43.252674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:43.282044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-66386601-458d-4412-8889-1ba1380a4604 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Oct 28 15:26:43.283383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 396/832] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:44.294498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:44.295488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:44.301656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:44.302184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:44.302953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:44.303382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:44.331261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-22cb54b1-9681-41c1-b568-76b62f7d0b38 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040534 Oct 28 15:26:44.331810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 437/833] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:45.343034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:45.344022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:45.350280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:45.351220 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:45.352097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:45.352557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:45.382408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5cb12f2d-0d8a-4488-8c0d-a7ff5c999adc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Oct 28 15:26:45.382984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 397/834] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:46.393982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:46.394874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:46.401406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:46.401925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:46.402726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:46.403106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:46.432724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c9e23a90-fc3b-46c0-8ab2-312b7d10d8c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Oct 28 15:26:46.433272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 438/835] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:47.443727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:47.445264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:47.451630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:47.452067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:47.453107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:47.453528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:47.481554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ee0b6a7f-1086-4534-939f-783cb7f1096e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 Oct 28 15:26:47.482071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 398/836] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:48.493298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:48.494199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:48.500344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:48.500813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:48.501561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:48.501982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:48.529970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cea6b6af-474a-4c10-887c-81c897657475 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041027 Oct 28 15:26:48.530506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 439/837] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:49.541130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:49.542031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:49.548115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:49.548601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:49.549357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:49.549780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:49.578685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-91ca8079-2728-4488-9a86-13b172748fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 Oct 28 15:26:49.579209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 399/838] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:50.590546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:50.591440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:50.597619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:50.598057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:50.598805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:50.599230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:50.626682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8a45ea1f-6ba0-4e25-ad1f-faa9798e5001 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039995 Oct 28 15:26:50.627224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 440/839] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:51.637712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:51.638619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:51.645018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:51.645462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:51.646222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:51.646649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:51.692143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-95028d6a-a5f2-4432-a058-ea0dcbd8c611 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057864 Oct 28 15:26:51.693033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 400/840] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:52.703970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:52.704926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:52.711306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:52.711752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:52.712540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:52.712971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:52.742491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-79157670-2cb0-4a3d-b3ad-82ea489b7da8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Oct 28 15:26:52.743262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 441/841] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:53.753377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:53.754267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:53.760737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:53.761176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:53.761926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:53.762349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:53.791251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-91ac4158-b77f-451c-9fb1-945bf204f6ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041699 Oct 28 15:26:53.791811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 401/842] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:54.802998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:54.803921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:54.810119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:54.810551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:54.811286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:54.811730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:54.840086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d7f51869-5748-4ec9-a2bf-bf0cc218b01b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Oct 28 15:26:54.840763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 442/843] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:55.851452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:55.852488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:55.858700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:55.859145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:55.859906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:55.860344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:55.888430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-78efab74-6b43-4f85-8e2a-96925b742f92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Oct 28 15:26:55.888977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 402/844] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:56.900293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:56.901154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:56.907528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:56.907991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:56.908802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:56.909231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:56.937264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4bbd9b65-6db0-488f-8711-88635af25284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 Oct 28 15:26:56.937799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 443/845] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:57.949016 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:57.949956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:57.956281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:57.956765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:57.957529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:57.957956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:57.986660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-af318011-b49f-4ccf-b318-d258f51b1fb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Oct 28 15:26:57.987198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 403/846] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:26:58.998111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:26:58.998940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:26:59.004629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:59.005071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:59.005819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:26:59.006298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:26:59.034361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6c7fed25-9872-4e57-b607-92ee12da2ca5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Oct 28 15:26:59.034898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 444/847] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:26:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:00.046437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:00.047344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:00.054070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:00.054515 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:00.055275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:00.055707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:00.084714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3a11c5a5-da1a-4064-bab2-e11eb01d2070 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042058 Oct 28 15:27:00.085279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 404/848] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:01.096596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:01.097857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:01.104817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:01.105870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:01.106696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:01.107129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:01.136369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6442d9bc-147a-451a-8cb0-f5b711ee3996 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Oct 28 15:27:01.136935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 445/849] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:02.147647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:02.149084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:02.155198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:02.155632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:02.156405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:02.156833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:02.184437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1aa4e2d2-be68-44e0-964c-fc6ce4929d1f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 Oct 28 15:27:02.184967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 405/850] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:03.194987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:03.196527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:03.202706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:03.203139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:03.203883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:03.204300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:03.231367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f12859d5-6e9d-44f7-b5ad-dc434d2a6274 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040090 Oct 28 15:27:03.231896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 446/851] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:04.242433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:04.243341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:04.249596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:04.250038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:04.250798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:04.251236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:04.280113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cd95c33f-d3ae-4800-a476-5fbe95ca4340 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Oct 28 15:27:04.280746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 406/852] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:05.291388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:05.292712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:05.299178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:05.299622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:05.300379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:05.300832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:05.328410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-505e787b-983b-43f0-8c1c-02dd9776ccee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041304 Oct 28 15:27:05.328957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 447/853] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:06.339394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:06.340331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:06.346530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:06.346968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:06.347731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:06.348159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:06.376309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0cc69dfc-da14-409b-b059-187b32bb6330 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040611 Oct 28 15:27:06.376872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 407/854] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:07.387963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:07.388885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:07.395240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:07.395674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:07.396438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:07.396863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:07.431664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37fc5fa2-0815-4989-b8d6-6093566d7324 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047209 Oct 28 15:27:07.432254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 448/855] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:08.442823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:08.443722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:08.450526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:08.450965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:08.451720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:08.452147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:08.482700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-04777b3c-2397-4e30-ac97-8dad3a3fffa0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Oct 28 15:27:08.483249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 408/856] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:09.495757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:09.497208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:09.505526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:09.505969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:09.506737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:09.507166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:09.535518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8e477f17-523e-4b8f-9403-5158c8de4974 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Oct 28 15:27:09.536067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 449/857] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:10.546030 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:10.546928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:10.553647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:10.554090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:10.554851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:10.555810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:10.591092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6f3fec2d-0fbe-41dc-b684-0525612adb2c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Oct 28 15:27:10.591652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 409/858] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:11.601785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:11.603353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:11.609585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:11.610030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:11.610786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:11.611216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:11.638899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3174dc31-748e-426c-a163-2ef5d607833b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Oct 28 15:27:11.639452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 450/859] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:12.650367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:12.651257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:12.657537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:12.658005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:12.658753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:12.659171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:12.688571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3e295f34-1466-41b3-b68d-8d17124c4e07 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Oct 28 15:27:12.689113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 410/860] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:13.700314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:13.701284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:13.707508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:13.707951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:13.708726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:13.709153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:13.740693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5545aca5-40b3-498a-bfa5-08ed1073da8b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040805 Oct 28 15:27:13.740693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 451/861] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:14.748989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:14.750023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:14.756296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:14.756823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:14.757591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:14.758024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:14.788247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-576983ac-64c4-458b-bf59-b5e257d1dd28 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Oct 28 15:27:14.788830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 411/862] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:15.799720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:15.800647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:15.807286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:15.807726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:15.808509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:15.808937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:15.838212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-87ec2900-ba2b-4cee-9e2b-0638fcea055a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Oct 28 15:27:15.838763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 452/863] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:16.850638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:16.851538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:16.858683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:16.859119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:16.859872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:16.860529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:16.889244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-33d28981-3c8f-4272-b099-73304e2b8a00 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Oct 28 15:27:16.889791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 412/864] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:17.900616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:17.901442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:17.907619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:17.908134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:17.908921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:17.909349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:17.938961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-da6d2d43-982d-4ace-9b72-c7d34f4ceff8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Oct 28 15:27:17.940709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 453/865] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:18.951575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:18.952498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:18.958792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:18.959201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:18.959956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:18.960376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:18.989908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-20b7e444-819c-4868-9c99-9186bee7ee8e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Oct 28 15:27:18.990615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 413/866] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:20.001104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:20.002106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:20.008198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:20.008664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:20.009416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:20.009835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:20.041237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f3cb01ea-7d19-4bb8-930e-cecdadbca14c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Oct 28 15:27:20.042089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 454/867] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:21.052562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:21.053396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:21.059546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:21.059981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:21.060765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:21.061188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:21.093935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-58c883cb-b2da-43a5-a017-3e67bfd820fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Oct 28 15:27:21.098060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 414/868] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:22.107250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:22.108244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:22.114272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:22.114699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:22.115446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:22.115865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:22.148884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6307ada9-1532-4861-b909-3dcee2480246 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Oct 28 15:27:22.149437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 455/869] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:23.160604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:23.161444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:23.168485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:23.168926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:23.169692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:23.170123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:23.199695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3aa124c5-104f-48d3-a2d5-99e64caddba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Oct 28 15:27:23.200249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 415/870] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:24.210783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:24.211681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:24.218021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:24.218463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:24.219227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:24.219656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:24.249254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-28b7724c-f874-45ad-9c9c-e4580d803524 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Oct 28 15:27:24.249819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 456/871] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:25.260382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:25.261404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:25.267649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:25.268092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:25.269142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:25.269570 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:25.298454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1564a0e7-e919-40ff-a8fd-b3c861fd97dd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Oct 28 15:27:25.299008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 416/872] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:26.309544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:27:26.310961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:26.317275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:26.317706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:26.318533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:26.318964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:26.348495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0ac3d483-45ba-4529-9ede-e5b2cae80183 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Oct 28 15:27:26.349046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 457/873] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:27:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:27:27.358812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:27:27.359721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:27:27.365703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:27.366186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:27.366907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:27:27.367335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:27:27.392955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [575e18ac-21d5-4dba-9ece-54d0407e7429] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 15:27:28.410062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [575e18ac-21d5-4dba-9ece-54d0407e7429] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 41442. Oct 28 15:27:28.474637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9410004e-667e-46b8-9b2d-04cd4c03e746 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action" status: 200 len: 69627 microversion: 2.1 time: 1.119474 Oct 28 15:27:28.475289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 417/874] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:27:27 2021] POST /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405/action => generated 69627 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:27:33.425216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:27:33.425805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:27:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:27:40.214501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:27:40.215067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:27:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:27:40.574382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:27:40.575934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:27:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:28:02.220004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-25008879-ee16-4c37-9102-038d5d3eb7ae tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] Calling method '.version_select at 0x7fdc12e381f0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:02.224230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25008879-ee16-4c37-9102-038d5d3eb7ae tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] [f53425ba-b377-4902-9c3e-d391ec296ae8] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 15:28:03.241287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [None req-25008879-ee16-4c37-9102-038d5d3eb7ae tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] [f53425ba-b377-4902-9c3e-d391ec296ae8] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 41952. Oct 28 15:28:03.326656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-25008879-ee16-4c37-9102-038d5d3eb7ae tempest-TestShelveInstance-729074200 tempest-TestShelveInstance-729074200-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1195942847" status: 202 len: 0 microversion: 2.1 time: 1.109722 Oct 28 15:28:03.326656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 458/875] 10.222.0.86 () {58 vars in 1253 bytes} [Thu Oct 28 15:28:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1195942847 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:05.056065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:05.056657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:05.063698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:05.064754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:05.065601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:05.066036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:05.236790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lazy-loading 'services' on Instance uuid 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:28:05.500941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-24d3b24f-ae8f-459c-bdc6-f6360bd8d55d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "DELETE /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86/os-volume_attachments/fdbd5ec6-ce3f-4a21-a543-a0e811a2f5fe" status: 202 len: 0 microversion: 2.1 time: 0.448375 Oct 28 15:28:05.501525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 418/876] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:28:05 2021] DELETE /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86/os-volume_attachments/fdbd5ec6-ce3f-4a21-a543-a0e811a2f5fe => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:06.614333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:06.615212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:06.625372 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:06.625816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:06.626593 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:06.627029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:06.652600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:28:06.879843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [d975515e-88ac-4899-80ac-88813ac51996] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 15:28:07.903452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [d975515e-88ac-4899-80ac-88813ac51996] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 42028. Oct 28 15:28:08.014714 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-735006f7-c901-49c4-b26f-131075bcce37 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 204 len: 0 microversion: 2.20 time: 1.408648 Oct 28 15:28:08.015294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 459/877] 10.222.0.86 () {60 vars in 1279 bytes} [Thu Oct 28 15:28:06 2021] DELETE /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 0 bytes in 1410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 15:28:08.025005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:08.025827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:08.033774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:08.034337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:08.036652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:08.036652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:08.166175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:08.173949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:08.175413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:08.176568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9a7782e5-686d-48e2-9b61-a94d993e2a06 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1723 microversion: 2.20 time: 0.156187 Oct 28 15:28:08.177110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 419/878] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:08 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:09.195122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:09.195726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:09.201879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:09.202320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:09.203630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:09.204054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:09.379121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:09.386764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:09.388249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:09.389415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6d3834c8-4d3d-430e-a27a-f3ecd1be6f14 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1723 microversion: 2.20 time: 0.198412 Oct 28 15:28:09.389963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 460/879] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:09 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:10.416723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:10.416723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:10.419737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:10.420253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:10.421140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:10.425307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:10.517706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:10.532466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:10.535277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:10.535277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7e22549a-b8c1-468f-91fb-68cac182a482 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1656 microversion: 2.20 time: 0.128470 Oct 28 15:28:10.546205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 420/880] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:10 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1656 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:10.566167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-bdd3bb23-e240-4c99-8c8f-3caa2761d319 req-f102beeb-881f-485a-a5da-67eb93b34a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc888dd6-aa57-4e8e-9d1b-9a38b32f3597", "name": "network-vif-deleted", "tag": "85c34099-a099-4021-9a51-9f8fd2eb32a5"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:10.574278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:28:10.574278 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:28:10.581019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-bdd3bb23-e240-4c99-8c8f-3caa2761d319 req-f102beeb-881f-485a-a5da-67eb93b34a99 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:10.581718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-bdd3bb23-e240-4c99-8c8f-3caa2761d319 req-f102beeb-881f-485a-a5da-67eb93b34a99 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:10.600133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-bdd3bb23-e240-4c99-8c8f-3caa2761d319 req-f102beeb-881f-485a-a5da-67eb93b34a99 service nova] Creating event network-vif-deleted:85c34099-a099-4021-9a51-9f8fd2eb32a5 for instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 on hv-cinder-78364 Oct 28 15:28:10.617739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-bdd3bb23-e240-4c99-8c8f-3caa2761d319 req-f102beeb-881f-485a-a5da-67eb93b34a99 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147905 Oct 28 15:28:10.622257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 461/881] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:28:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:28:11.553948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:11.555206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:11.561475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:11.562163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:11.563591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:11.564176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:11.610936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:11.612903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:11.613524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lazy-loading 'fault' on Instance uuid cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:28:11.681600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:11.691057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:11.692853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:11.694277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4b7fa616-d0e0-41dc-971a-cf9fdf3e987d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 200 len: 1371 microversion: 2.20 time: 0.144663 Oct 28 15:28:11.696414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 421/882] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:11 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:12.714063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:12.714776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:12.722153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:12.722902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:12.723673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:12.724098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:12.738594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. Oct 28 15:28:12.739184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:28:12.740006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-03ad146a-30f1-4fb5-8b12-1863fb8688b6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 404 len: 111 microversion: 2.20 time: 0.029996 Oct 28 15:28:12.743968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 462/883] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:12 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 15:28:12.759017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-241748b2-5dbd-497c-b222-bfaa1007e4a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '.version_select at 0x7fdc182e9d30>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:12.902902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-241748b2-5dbd-497c-b222-bfaa1007e4a7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377492745" status: 204 len: 0 microversion: 2.20 time: 0.157657 Oct 28 15:28:12.903888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 422/884] 10.222.0.86 () {60 vars in 1258 bytes} [Thu Oct 28 15:28:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377492745 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 15:28:13.849581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'create', calling method: .version_select at 0x7fdc12d3f790>, body: {"keypair": {"name": "tempest-keypair-101645175"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:13.877050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:28:13.882803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:28:14.097546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:28:14.101127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:28:14.113859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b9daee13-29c0-4d61-a679-527be809aac3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.268073 Oct 28 15:28:14.114441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 463/885] 10.222.0.86 () {62 vars in 1198 bytes} [Thu Oct 28 15:28:13 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 269 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 15:28:16.425145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1613842515", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adaae7dc-8ce6-4ed0-8c77-33a94b998a91"}], "security_groups": [{"name": "tempest-securitygroup--1588261043"}], "key_name": "tempest-keypair-101645175", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:16.523747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] validate_networks() for [('adaae7dc-8ce6-4ed0-8c77-33a94b998a91', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:28:16.984054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:28:16.984547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:28:16.985038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:28:16.985433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:28:16.986107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:28:16.994917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:16.995349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:16.996128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:16.996583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:17.012578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:28:17.017044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Getting quotas for user e40ffcd9186b49bf9326b1f2c8efe7ac and project 4c1cee9c314942b8b8e9be0c40ec04f3. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:28:17.028367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:28:17.030704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:28:17.171163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-04656e69-a8bf-4cee-a263-bc1d72e67eb9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.750572 Oct 28 15:28:17.171801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 423/886] 10.222.0.86 () {62 vars in 1187 bytes} [Thu Oct 28 15:28:16 2021] POST /compute/v2.1/servers => generated 402 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 15:28:17.183758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:17.184679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:17.253179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:17.260247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:17.261738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:17.262801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ec40f8cf-7ab4-47d7-97b9-dbc73bed6786 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1281 microversion: 2.20 time: 0.084967 Oct 28 15:28:17.263350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 464/887] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:17 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:18.282279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:18.282907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:18.289303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:18.289745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:18.290510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:18.290933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:18.348584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:18.356452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:18.357979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:18.359053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-21c73da8-760f-417f-96c7-2bd9634a657f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1285 microversion: 2.20 time: 0.081853 Oct 28 15:28:18.359601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 424/888] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:18 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:19.377306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:19.377911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:19.384046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:19.384523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:19.385487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:19.386086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:19.448029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:19.455820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:19.457387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:19.458525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f10889de-e13b-4abe-9e07-02ca4e79143c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1351 microversion: 2.20 time: 0.085017 Oct 28 15:28:19.459061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 465/889] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:19 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 15:28:20.482977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:20.483595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:20.490353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:20.490794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:20.491564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:20.491993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:20.611017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:20.618782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:20.620403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:20.621509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-05ff24c4-4423-471a-b99b-fe3a2181214a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.143247 Oct 28 15:28:20.622151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 425/890] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:20 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:20.922837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-1f35f2ab-8b14-4fc7-a22b-49d1e5d7f0f9 req-6ce72798-693a-42b6-a3af-82aec4e4f711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b1113c-fcf2-4a62-962c-98c13d3fbb28", "tag": "2af929d2-70e7-4606-bf03-5b2151449c8d"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:20.926016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:28:20.926016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:28:20.933959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-1f35f2ab-8b14-4fc7-a22b-49d1e5d7f0f9 req-6ce72798-693a-42b6-a3af-82aec4e4f711 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:20.934491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-1f35f2ab-8b14-4fc7-a22b-49d1e5d7f0f9 req-6ce72798-693a-42b6-a3af-82aec4e4f711 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:20.954007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-1f35f2ab-8b14-4fc7-a22b-49d1e5d7f0f9 req-6ce72798-693a-42b6-a3af-82aec4e4f711 service nova] Creating event network-changed:2af929d2-70e7-4606-bf03-5b2151449c8d for instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 on hv-cinder-78364 Oct 28 15:28:20.955632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-1f35f2ab-8b14-4fc7-a22b-49d1e5d7f0f9 req-6ce72798-693a-42b6-a3af-82aec4e4f711 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037515 Oct 28 15:28:20.956491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 466/891] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:28:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:28:21.638788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:21.639390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:21.646510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:21.646947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:21.647701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:21.648125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:21.769930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:21.777692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:21.782631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:21.782631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-acddf9d0-ddc0-467c-aabf-f519be582fec tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.145094 Oct 28 15:28:21.782631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 426/892] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:21 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:22.799262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:22.799973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:22.806250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:22.806681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:22.807425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:22.807841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:23.122501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:23.130234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:23.131708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:23.132819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-20879c27-234e-44ea-9da5-bd0965bbefcd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.338029 Oct 28 15:28:23.133368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 467/893] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:22 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:24.150404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:24.150946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:24.156651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:24.157089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:24.157831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:24.158254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:24.273098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:24.280575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:24.282074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:24.283137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1d9c9a12-02bd-4874-a406-bdb5d7def7af tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.136693 Oct 28 15:28:24.283677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 427/894] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:24 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:25.300495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:25.301081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:25.307267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:25.307704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:25.308487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:25.308918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:25.424856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:25.432651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:25.434247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:25.435329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5398a7c5-cd1b-46b8-8a6a-679a0e585775 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.138547 Oct 28 15:28:25.435873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 468/895] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:25 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:26.452663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:26.453820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:26.459985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:26.460465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:26.461225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:26.461654 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:26.589249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:26.598287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:26.599818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:26.601087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-495c1f03-88a6-4189-b3f0-7693d70c5b56 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.152157 Oct 28 15:28:26.601644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 428/896] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:26 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:27.618626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:27.619226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:27.625369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:27.625807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:27.626565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:27.626992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:27.749804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:27.753566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:27.755035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:27.756101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-083a4d3d-1230-4c2c-928c-5a1c4a9430ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.141138 Oct 28 15:28:27.756677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 469/897] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:27 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:28.373106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-88dae57d-2f45-4c5a-b894-f520e5f9b923 req-bae820c4-7237-4c9f-b708-765595423990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b1113c-fcf2-4a62-962c-98c13d3fbb28", "name": "network-vif-plugged", "status": "completed", "tag": "2af929d2-70e7-4606-bf03-5b2151449c8d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:28.374892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:28:28.374892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:28:28.381764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-88dae57d-2f45-4c5a-b894-f520e5f9b923 req-bae820c4-7237-4c9f-b708-765595423990 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:28.382206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-88dae57d-2f45-4c5a-b894-f520e5f9b923 req-bae820c4-7237-4c9f-b708-765595423990 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:28.392745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-88dae57d-2f45-4c5a-b894-f520e5f9b923 req-bae820c4-7237-4c9f-b708-765595423990 service nova] Creating event network-vif-plugged:2af929d2-70e7-4606-bf03-5b2151449c8d for instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 on hv-cinder-78364 Oct 28 15:28:28.397883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-88dae57d-2f45-4c5a-b894-f520e5f9b923 req-bae820c4-7237-4c9f-b708-765595423990 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147147 Oct 28 15:28:28.398460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 429/898] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:28:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:28:28.773923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:28.775072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:28.780955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:28.781397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:28.782155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:28.782572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:28.902707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:28.910978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:28.912617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:28.913781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f1e577d1-58f1-4ef9-9596-1b2588b13989 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.143782 Oct 28 15:28:28.914329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 470/899] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:28 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:29.932021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:29.932731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:29.938513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:29.938946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:29.939688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:29.940114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:30.067489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:30.071000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:30.072608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:30.073704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-097880e5-9e82-4ba7-8f44-6efcac1507ad tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1407 microversion: 2.20 time: 0.146298 Oct 28 15:28:30.083925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 430/900] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:29 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:31.090990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:31.091706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:31.098689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:31.099130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:31.099886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:31.100306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:31.222413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:31.230187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:31.231792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:28:31.232955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-da0cd18f-90c9-4839-a3cb-6f231e33b172 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1599 microversion: 2.20 time: 0.145758 Oct 28 15:28:31.233499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 471/901] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:28:31 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:31.250129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:28:31.250666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:31.256711 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:31.257144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:31.257887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:31.258306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:31.335866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d7623d8-fcf1-40cd-957f-4f85889c5ae0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089372 Oct 28 15:28:31.336483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 431/902] 10.222.0.86 () {60 vars in 1315 bytes} [Thu Oct 28 15:28:31 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:28:32.471570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:32.472523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:32.479683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:32.479992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:32.480820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:32.481253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:32.534297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-3dfca4e0-a5f6-4e46-8835-d2ea4c888760 req-0c674a9f-db40-449c-b744-f4618a018e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b1113c-fcf2-4a62-962c-98c13d3fbb28", "tag": "2af929d2-70e7-4606-bf03-5b2151449c8d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:32.535812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:28:32.535812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:28:32.542665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-3dfca4e0-a5f6-4e46-8835-d2ea4c888760 req-0c674a9f-db40-449c-b744-f4618a018e87 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:32.543087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-3dfca4e0-a5f6-4e46-8835-d2ea4c888760 req-0c674a9f-db40-449c-b744-f4618a018e87 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:32.548891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6344aae7-060b-48d0-974b-105e366e7865 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.085907 Oct 28 15:28:32.552540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 472/903] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:32 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:32.555387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-3dfca4e0-a5f6-4e46-8835-d2ea4c888760 req-0c674a9f-db40-449c-b744-f4618a018e87 service nova] Creating event network-changed:2af929d2-70e7-4606-bf03-5b2151449c8d for instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 on hv-cinder-78364 Oct 28 15:28:32.560378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-3dfca4e0-a5f6-4e46-8835-d2ea4c888760 req-0c674a9f-db40-449c-b744-f4618a018e87 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094877 Oct 28 15:28:32.561175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 432/904] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:28:33.559886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:33.561070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:33.568556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:33.568998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:33.569763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:33.570191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:33.631067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a603f5a0-3ffc-4ecc-8a66-8c689847a391 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.075121 Oct 28 15:28:33.631696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 473/905] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:33 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:34.642972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:34.644135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:34.650514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:34.650957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:34.651711 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:34.652142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:34.717577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6af04803-9078-44e6-b1d8-3a3d90821fe4 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.079164 Oct 28 15:28:34.718185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 433/906] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:34 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:35.728820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:35.729810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:35.737127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:35.737574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:35.738336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:35.738767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:35.807590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26af1ce2-0d60-48a5-b6ac-5edced3a2dd7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.082714 Oct 28 15:28:35.808227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 474/907] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:35 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:36.820440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:36.821461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:36.828143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:36.828780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:36.829581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:36.830007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:36.899314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-29d02d6a-1081-4cbb-8d2b-66a6773598f7 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.084179 Oct 28 15:28:36.899903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 434/908] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:36 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:37.910105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:37.911088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:37.918090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:37.918554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:37.919308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:37.919763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:37.986019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8fdb4dfa-d330-4a42-9923-d04c020a79e9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.079292 Oct 28 15:28:37.986617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 475/909] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:37 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:38.997399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:38.998303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:39.005515 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:39.005958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:39.006712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:39.007139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:39.066041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dd4e70b2-dff2-4b9e-885b-7bb61725d2cc tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.072628 Oct 28 15:28:39.066835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 435/910] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:38 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:40.077394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:40.078441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:40.085772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:40.086193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:40.086955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:40.087385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:40.160896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6505db68-118f-4686-9a7e-6886c4308bf0 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.087253 Oct 28 15:28:40.165476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 476/911] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:40 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:41.171826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:41.173518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:41.180228 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:41.180690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:41.181442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:41.181866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:41.251312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aa070adc-1dc8-4270-af47-7fe357d885f3 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.083332 Oct 28 15:28:41.254328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 436/912] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:41 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:42.262358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:42.263334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:42.270693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:42.271126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:42.271875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:42.272304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:42.363671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c5516c64-5caa-41a3-a827-7f9a6d2ff62e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 14 microversion: 2.20 time: 0.105167 Oct 28 15:28:42.364337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 477/913] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:42 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:28:43.374603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:43.375579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:43.382237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:43.382676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:43.383419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:43.383865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:43.457282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-28e668eb-8b0b-467c-9cb0-9fc4ddbb1752 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 1799 microversion: 2.20 time: 0.086509 Oct 28 15:28:43.458018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 437/914] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:43 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 1799 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:28:44.468691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:44.470273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:44.477186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:44.477631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:44.478409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:44.478839 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:44.564548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6d6936d2-63ba-4add-9c18-3c0ea5511267 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 12971 microversion: 2.20 time: 0.099841 Oct 28 15:28:44.565213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 478/915] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:44 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 12971 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:45.580529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:45.581960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:45.591863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:45.592307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:45.593112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:45.593538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:45.679736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5b300408-b6de-4da1-bcc3-1f19641830d6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 18356 microversion: 2.20 time: 0.107001 Oct 28 15:28:45.680368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 438/916] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:45 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 18356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:46.691415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:46.692419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:46.699365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:46.699842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:46.700690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:46.701122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:46.784545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4ce18847-fa4e-4f87-b418-7078a1da6c40 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 18356 microversion: 2.20 time: 0.097559 Oct 28 15:28:46.785181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 479/917] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:46 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 18356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:47.795809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:47.796843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:47.804312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:47.809885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:47.809885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:47.809885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:47.879229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-eaeea54b-12f8-433b-b33a-b77eb6144bbe tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 20171 microversion: 2.20 time: 0.087291 Oct 28 15:28:47.880428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 439/918] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:47 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 20171 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:48.892033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:48.893056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:48.900375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:48.901036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:48.901701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:48.902142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:49.043238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ade5a9a5-32e3-46a4-a26a-ce33cae2cb04 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 22660 microversion: 2.20 time: 0.155687 Oct 28 15:28:49.044081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 480/919] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:48 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 22660 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:50.054865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:50.055882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:50.062784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:50.063227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:50.063997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:50.064453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:50.145677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7850ddec-acb4-4c0a-a29a-0748de9c7317 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 23596 microversion: 2.20 time: 0.094671 Oct 28 15:28:50.146329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 440/920] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:50 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 23596 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:51.157543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:51.158532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:51.165546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:51.165990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:51.166745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:51.167169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:51.251310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6454d975-ebb8-4869-9a06-5523408144cf tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 24625 microversion: 2.20 time: 0.096955 Oct 28 15:28:51.252133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 481/921] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:51 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 24625 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:52.263132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:52.264121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:52.271839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:52.272275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:52.273058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:52.273483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:52.365765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5cdda74d-263b-4dab-b82f-05c473c333f1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 26011 microversion: 2.20 time: 0.106419 Oct 28 15:28:52.366548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 441/922] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:52 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 26011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:53.378223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:53.379126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:53.385942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:53.386379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:53.387136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:53.387557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:53.472550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f12f5ee6-1193-4251-99f6-cb77a1928d4a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 27089 microversion: 2.20 time: 0.098777 Oct 28 15:28:53.473178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 482/923] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:53 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 27089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:54.485800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:54.486822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:54.493722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:54.494164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:54.494928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:54.495359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:54.592977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f54c2f96-b704-4428-8e28-4c36ec03f2c5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 27648 microversion: 2.20 time: 0.111778 Oct 28 15:28:54.593605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 442/924] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:54 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 27648 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:55.605249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:55.606226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:55.613555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:55.613986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:55.614739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:55.615155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:55.708353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b25feac1-c5c4-451d-b185-8c95e5606a09 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28035 microversion: 2.20 time: 0.107019 Oct 28 15:28:55.709289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 483/925] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:55 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:28:56.720319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:56.721407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:56.728196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:56.730427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:56.730427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:56.730427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:56.810413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f9359786-87be-4c93-bae7-ada73f0f214c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.094661 Oct 28 15:28:56.811283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 443/926] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:56 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:57.822713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:57.823691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:57.830982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:57.831411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:57.832155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:57.832600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:57.909907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3b0dba99-d0a1-4ecb-b5f7-2be92a2bdf6f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.091181 Oct 28 15:28:57.910523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 484/927] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:57 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:28:58.921541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:28:58.922542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:28:58.929318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:58.929761 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:58.930519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:28:58.930950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:28:58.991074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3fcbb5b5-78e4-4dae-b5d3-53a47f69915a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.073437 Oct 28 15:28:58.991843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 444/928] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:58 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:00.003638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:00.004704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:00.013380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:00.013822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:00.018745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:00.019553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:00.086122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7defa9ac-3eab-41af-bde7-fa652edd9090 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.087174 Oct 28 15:29:00.086790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 485/929] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:28:59 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:01.105894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:01.106798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:01.113616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:01.114056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:01.114812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:01.115238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:01.176489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb4ea1b4-785b-497a-9b3d-d31421ce9281 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.074464 Oct 28 15:29:01.178110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 445/930] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:01 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:02.187969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:02.188966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:02.195614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:02.196045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:02.196846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:02.197270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:02.268735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3a1c1aa2-4e56-495e-8a9a-8bf40a31f13f tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.084305 Oct 28 15:29:02.269363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 486/931] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:02 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:03.280304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:03.281318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:03.288156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:03.288630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:03.289385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:03.289816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:03.363032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-596c12c3-a93d-42fa-a415-d93b0b7b64ac tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.086762 Oct 28 15:29:03.363664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 446/932] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:03 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:04.373892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:04.375385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:04.382039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:04.382471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:04.383214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:04.383634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:04.446117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-297094d0-e73d-4e14-99f7-eb6e5a929b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.076047 Oct 28 15:29:04.446744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 487/933] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:04 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:05.458479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:05.459497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:05.466224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:05.466669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:05.467437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:05.467867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:05.531792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e68e7236-c64a-4a67-95c5-0a121372bba5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.076680 Oct 28 15:29:05.532510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 447/934] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:05 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:06.543171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:06.544177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:06.551647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:06.552086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:06.552880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:06.553366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:06.619766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-efe83c29-4552-42c8-b4dd-df0910925b94 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.080875 Oct 28 15:29:06.620425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 488/935] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:06 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:07.631936 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:07.632989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:07.639780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:07.640891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:07.641667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:07.642099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:07.704482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-12841f5f-cc4a-4ec6-aa86-79419c792f6b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.076333 Oct 28 15:29:07.705102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 448/936] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:07 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:08.715416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:08.716406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:08.723803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:08.724234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:08.725013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:08.725435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:08.798052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e44f54c0-32c6-410b-b1ae-49d5bfa63949 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.086484 Oct 28 15:29:08.798706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 489/937] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:08 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:09.810216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:09.811121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:09.818172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:09.818614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:09.819381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:09.819807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:09.890459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1c87b923-d829-42a9-888c-1970b168ebbd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28152 microversion: 2.20 time: 0.084238 Oct 28 15:29:09.891081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 449/938] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:09 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:10.903348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:10.904242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:10.911654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:10.912090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:10.912857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:10.913283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:10.997170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-85e80674-cf52-42ed-a4ae-d53c505186a1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28442 microversion: 2.20 time: 0.097702 Oct 28 15:29:10.998073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 490/939] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:10 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28442 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:12.009332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:12.010350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:12.017715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:12.018410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:12.019177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:12.019608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:12.083574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d0248e69-eaee-4797-9a09-6c9102ab7502 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28442 microversion: 2.20 time: 0.078080 Oct 28 15:29:12.084209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 450/940] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:12 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28442 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:13.096032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:13.097063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:13.103514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:13.103957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:13.104746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:13.105173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:13.184096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a8d5c8ae-76ab-44b1-b610-072f44d84b1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.092577 Oct 28 15:29:13.184747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 491/941] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:13 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:14.196043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:14.197084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:14.203773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:14.204896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:14.205659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:14.206088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:14.268621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6c4b4dde-3f5c-4c1d-b36d-ce92bac6916e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.076053 Oct 28 15:29:14.269479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 451/942] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:14 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:15.280419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:15.281409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:15.288854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:15.289294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:15.290079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:15.290506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:15.352109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0b73b169-61bd-4221-bb4a-6a266f51cd0e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.075534 Oct 28 15:29:15.352763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 492/943] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:15 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:16.364703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:16.365680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:16.372276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:16.372748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:16.373494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:16.373914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:16.436123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-85d2df27-0dac-408e-abf1-148c8174b44c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.076060 Oct 28 15:29:16.436779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 452/944] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:16 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:17.448486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:17.449427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:17.457150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:17.457614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:17.458384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:17.458809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:17.520961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9372bf3f-7825-4bac-9968-d7003ae79832 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.076654 Oct 28 15:29:17.521577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 493/945] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:17 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:18.534028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:18.535001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:18.541689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:18.542121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:18.542865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:18.543305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:18.607616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9ba6b6e4-4727-4667-9e85-ea321310dae9 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.077460 Oct 28 15:29:18.608157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 453/946] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:18 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:19.619735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:19.620686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:19.627493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:19.627935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:19.628726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:19.629157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:19.689476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ee6ccf5b-69ea-4d9e-8c10-cfd9a720ab89 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.073859 Oct 28 15:29:19.690074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 494/947] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:19 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:20.701209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:20.702219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:20.709624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:20.710071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:20.710892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:20.711319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:20.781907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1af6a879-25c1-459f-8ea6-2c8549e1d4a5 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.084607 Oct 28 15:29:20.782558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 454/948] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:20 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:29:21.794095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:21.795075 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:21.802337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:21.802770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:21.803521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:21.803939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:21.864633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-735a5bf9-a5b8-45f3-ab53-28c7666cc201 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.074356 Oct 28 15:29:21.865250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 495/949] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:21 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:22.876173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:22.877107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:22.883777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:22.884212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:22.884988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:22.885413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:22.946797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e3c9528b-76a7-4c57-8c2f-7676970e869b tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.074605 Oct 28 15:29:22.947644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 455/950] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:22 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:23.959106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:23.960094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:23.966872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:23.967307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:23.968055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:23.968508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:24.031367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8ef51841-67a4-4f6b-b98d-b1372eb96e16 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.076225 Oct 28 15:29:24.032224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 496/951] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:23 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:25.044046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:25.045098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:25.052341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:25.052814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:25.053612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:25.054044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:25.116995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-63047f74-07f0-478f-b446-ca204a7a0c8e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.076895 Oct 28 15:29:25.117802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 456/952] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:25 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:26.129685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:26.130669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:26.137482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:26.137922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:26.138667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:26.139086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:26.206781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b699fcc2-7fb8-4073-ab20-1a08feb9094a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.081049 Oct 28 15:29:26.207382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 497/953] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:26 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:27.218681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:27.219659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:27.226451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:27.226799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:27.227548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:27.227965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:27.294311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3c029c24-0bae-4bc4-917d-304c8e1a6998 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.079586 Oct 28 15:29:27.294920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 457/954] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:27 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:28.306703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:28.307713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:28.314410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:28.314840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:28.315582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:28.316001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:28.374926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-12a8303e-5a25-4fbe-a1ec-ffb20d4208e6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.072126 Oct 28 15:29:28.375534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 498/955] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:28 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:29.387258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:29.388236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:29.395359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:29.395794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:29.396573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:29.396998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:29.463462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a7f92c66-b35f-4d79-a171-1eca0985ac22 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.080045 Oct 28 15:29:29.464182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 458/956] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:29 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:30.474744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:30.476242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:30.482978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:30.483421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:30.484185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:30.484636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:30.548565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f472796-9f81-4383-8be4-c26bc3230c8d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.077660 Oct 28 15:29:30.549971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 499/957] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:30 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:31.560800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:31.562347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:31.568658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:31.569105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:31.569911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:31.570338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:31.633977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f081a281-fb74-435c-91ab-d76b500ec04c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.077143 Oct 28 15:29:31.637420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 459/958] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:31 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:32.645928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:32.647636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:32.654524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:32.654794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:32.655670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:32.656105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:32.723199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd35e51b-0cc9-4b70-88ff-8cf8082e1291 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.081332 Oct 28 15:29:32.723882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 500/959] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:32 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:33.735264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:33.736357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:33.743826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:33.744276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:33.745076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:33.745508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:33.812569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-edb8528e-77cf-4a85-9802-ff5781781f1e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.081188 Oct 28 15:29:33.813195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 460/960] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:33 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:34.825614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:34.826607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:34.833468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:34.833912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:34.834666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:34.835094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:34.899509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3596b7ce-d096-4e5b-b919-960e0836eaf1 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.078251 Oct 28 15:29:34.900125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 501/961] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:34 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:35.911290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:35.912277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:35.919025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:35.919473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:35.920227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:35.920676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:35.989100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-feacc5d7-559f-4590-9fec-f53f7c49aabd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.081588 Oct 28 15:29:35.989984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 461/962] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:35 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:37.001187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:37.002127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:37.009804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:37.010237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:37.010979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:37.011395 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:37.074339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4dd5d9a4-3a76-4775-be5d-eb65aefd4d0c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.077403 Oct 28 15:29:37.074967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 502/963] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:36 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:38.087063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:38.087979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:38.094878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:38.095322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:38.096092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:38.096551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:38.167770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-df7f12c7-5bb0-441d-b035-0daef01bfd6a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.085370 Oct 28 15:29:38.168412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 462/964] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:38 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:29:39.179682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:39.180738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:39.188294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:39.188754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:39.189506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:39.189922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:39.250367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7e6b8b6d-639d-4386-b430-fb22b41d122e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.074451 Oct 28 15:29:39.250923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 503/965] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:39 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:40.262982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:40.263885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:40.270838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:40.271272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:40.272022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:40.272466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:40.337368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-955e6528-90fa-4ce3-9534-ac8f55788518 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.078333 Oct 28 15:29:40.338287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 463/966] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:40 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:41.349732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:41.350663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:41.357474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:41.357918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:41.358674 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:41.359103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:41.433479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dd8e5c9e-955b-4674-ba5b-16fc223642ca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.087879 Oct 28 15:29:41.434145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 504/967] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:41 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:42.446414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:42.447406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:42.454374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:42.454815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:42.455571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:42.455997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:42.529518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4c117252-a6c3-4e74-b2cd-8eef606c4837 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.087428 Oct 28 15:29:42.530151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 464/968] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:42 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:43.542084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:43.543058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:43.549798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:43.550262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:43.551046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:43.551464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:43.621286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0ae8438a-020a-4279-9ce8-211d238c8881 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 28610 microversion: 2.20 time: 0.083526 Oct 28 15:29:43.622172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 505/969] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:43 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 28610 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:44.633155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:44.634817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:44.641534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:44.641970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:44.642733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:44.643411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:44.731362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-32c2c4b3-796c-40ab-9676-e8cc02155890 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 29821 microversion: 2.20 time: 0.102169 Oct 28 15:29:44.732011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 465/970] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:44 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 29821 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:45.743239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:45.744220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:45.751388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:45.757184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:45.757184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:45.757184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:45.838541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c1724b04-e4ea-4c2c-921f-f87ddc41262d tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 31881 microversion: 2.20 time: 0.099003 Oct 28 15:29:45.839165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 506/971] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:45 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 31881 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:46.850669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:46.851672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:46.859237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:46.859678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:46.860474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:46.860933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:46.943412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ee1aee4d-0454-4358-af93-5f8e70a02822 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 33143 microversion: 2.20 time: 0.096944 Oct 28 15:29:46.944043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 466/972] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:46 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 33143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:47.955427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:47.956480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:47.963238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:47.963676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:47.964451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:47.964878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:48.044913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5ec6a0fc-c278-49b3-b280-d3c7cbb01a12 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 34062 microversion: 2.20 time: 0.093253 Oct 28 15:29:48.045452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 507/973] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:47 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 34062 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:49.057442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:49.058351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:49.065145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:49.065592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:49.066353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:49.066784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:49.144275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bec9bc01-d39e-42bf-82ff-7f9ca5ca6290 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 35219 microversion: 2.20 time: 0.091251 Oct 28 15:29:49.144942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 467/974] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:49 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 35219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:50.157482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:50.159227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:50.166072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:50.166509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:50.167258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:50.167682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:50.249556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4b801d8e-38c5-4ccb-bc7a-caa3dd21ecb6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 36525 microversion: 2.20 time: 0.096870 Oct 28 15:29:50.250173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 508/975] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:50 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 36525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:29:51.262885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:51.263788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:51.270941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:51.271384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:51.272148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:51.272603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:51.346114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f04cee56-4d5f-4f3f-86fe-26a6ec9b5eca tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38007 microversion: 2.20 time: 0.088018 Oct 28 15:29:51.346740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 468/976] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:51 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38007 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:52.358873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:52.359869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:52.366909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:52.367362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:52.368132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:52.368594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:52.446841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9b3a7083-1662-49db-8c9f-5921cac6c6fd tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38166 microversion: 2.20 time: 0.091912 Oct 28 15:29:52.447503 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 509/977] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:52 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38166 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:53.459879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:53.460912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:53.468251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:53.468720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:53.469483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:53.469913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:53.531607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41ef6dca-eca8-46ad-bbe0-d2f4be9d5227 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38166 microversion: 2.20 time: 0.075614 Oct 28 15:29:53.532237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 469/978] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:53 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38166 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:54.544738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:54.545791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:54.552619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:54.553064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:54.553825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:54.554255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:54.620913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e07cc426-d411-4923-91da-88304fb66c7c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38166 microversion: 2.20 time: 0.080628 Oct 28 15:29:54.622154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 510/979] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:54 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38166 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:55.633899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:55.634897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:55.642217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:55.642662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:55.643676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:55.644105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:55.717069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3c8076cd-e142-410c-a113-4062550de692 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38249 microversion: 2.20 time: 0.087034 Oct 28 15:29:55.717923 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 470/980] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:55 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:29:56.729400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:29:56.730382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:56.736927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:56.737368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:56.738129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:56.738551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:56.811645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c9c4cb1-9ac7-4ad9-a024-29c40dbc7a84 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action" status: 200 len: 38309 microversion: 2.20 time: 0.086166 Oct 28 15:29:56.812316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 511/981] 10.222.0.86 () {62 vars in 1318 bytes} [Thu Oct 28 15:29:56 2021] POST /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/action => generated 38309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:29:56.822591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:29:56.824144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:29:56.830069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:56.830592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:56.831364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:29:56.831789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:29:56.857846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-66ec857b-3542-4e4b-9860-56b4bc668e1a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/ips" status: 200 len: 151 microversion: 2.20 time: 0.039207 Oct 28 15:29:56.858422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 471/982] 10.222.0.86 () {60 vars in 1288 bytes} [Thu Oct 28 15:29:56 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:30:53.442578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:30:53.443289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:30:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:31:00.233756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:31:00.234318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:31:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:31:00.591840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:31:00.592326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:31:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:31:23.325575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:31:23.326132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:31:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:32:50.071645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:32:50.072210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:32:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:33:16.024436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:33:16.024970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:33:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:34:05.528017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 15:34:05.532550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:05.533127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:05.539273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:05.539711 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:05.540497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:05.540917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:05.564944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:34:05.894721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0db9d3f0-27ea-4768-8f2d-31373c012af9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "DELETE /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 204 len: 0 microversion: 2.1 time: 0.363207 Oct 28 15:34:05.894721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 512/983] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:34:05 2021] DELETE /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:34:05.896472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 15:34:05.906513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:05.906513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:05.906513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:05.906774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:05.907516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:05.907948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:06.107148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:06.114766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6db73976-1d26-44de-886a-32346bd0eddb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.220493 Oct 28 15:34:06.115318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 472/984] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:07.131599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:07.132206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:07.151467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:07.151902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:07.152817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:07.153767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:07.157043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 46316. Oct 28 15:34:07.330611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:07.338244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62402a12-e8eb-404a-8056-5b633c468d59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.210743 Oct 28 15:34:07.338823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 513/985] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:08.354844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:08.355394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:08.375912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:08.376357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:08.377157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:08.377590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:08.381057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 46332. Oct 28 15:34:08.513505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:08.521348 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1945ff57-cf5d-42a6-abed-dc80851fea2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.170252 Oct 28 15:34:08.521897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 473/986] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:08 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:09.538387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:09.538996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:09.545664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:09.546104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:09.546864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:09.547294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:09.662801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:09.671017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cc4dce0d-d375-44c3-8c9c-fa8f724c2016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136275 Oct 28 15:34:09.671566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 514/987] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:10.686972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:10.687572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:10.693684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:10.694115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:10.694859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:10.695275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:10.815479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:10.823083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-144a7ea2-1b63-4b28-8a11-a87d691f993c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139727 Oct 28 15:34:10.823630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 474/988] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:11.840255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:11.840893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:11.847059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:11.847500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:11.848253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:11.848723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:11.969328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:11.977069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-924c9824-b1ec-47d9-af42-451c14e1239a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140480 Oct 28 15:34:11.977605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 515/989] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:11.989461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:11.989973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:11.996060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:11.996453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:11.997200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:11.997661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:12.021066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:34:12.328968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-931fcb03-ae13-4b2e-bb7e-b05f8ce522ed tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "DELETE /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 204 len: 0 microversion: 2.1 time: 0.342766 Oct 28 15:34:12.329464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 475/990] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:34:11 2021] DELETE /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:34:12.338559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:12.339161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:12.345510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:12.345949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:12.346702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:12.347127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:12.464999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:12.472781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ecc36a2e-ecd7-4d4e-acf1-d70857819c31 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1555 microversion: 2.1 time: 0.137818 Oct 28 15:34:12.473340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 516/991] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:12 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:12.994889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:12.995633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:13.002257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:13.002738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:13.003492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:13.003873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:13.128415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:13.135908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ae2d756a-90f7-438e-b16d-4a829018219f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145007 Oct 28 15:34:13.136466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 476/992] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:13.460910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:34:13.461153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:34:13.489419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:13.490023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:13.496113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:13.496596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:13.497356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:13.497777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:13.616199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:13.623461 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8846f285-a4aa-4a6f-ae71-548cd10304fe tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1555 microversion: 2.1 time: 0.137634 Oct 28 15:34:13.624093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 517/993] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:13 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:13.873876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-1675ab93-1c6f-4359-9246-e68504e1cd89 req-020043b2-a043-4d9d-b56a-5b07ae32d8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b317ef-28ae-443d-9981-0dc1561cdcab", "name": "network-vif-deleted", "tag": "0f927fe4-ef21-420a-b6f9-4363b60dfe6e"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:34:13.875435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:34:13.875435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:34:13.882099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1675ab93-1c6f-4359-9246-e68504e1cd89 req-020043b2-a043-4d9d-b56a-5b07ae32d8cf service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:13.882533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1675ab93-1c6f-4359-9246-e68504e1cd89 req-020043b2-a043-4d9d-b56a-5b07ae32d8cf service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:13.896644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-1675ab93-1c6f-4359-9246-e68504e1cd89 req-020043b2-a043-4d9d-b56a-5b07ae32d8cf service nova] Creating event network-vif-deleted:0f927fe4-ef21-420a-b6f9-4363b60dfe6e for instance 66b317ef-28ae-443d-9981-0dc1561cdcab on hv-cinder-78364 Oct 28 15:34:13.902139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-1675ab93-1c6f-4359-9246-e68504e1cd89 req-020043b2-a043-4d9d-b56a-5b07ae32d8cf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084091 Oct 28 15:34:13.902822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 477/994] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:34:14.152628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:14.153422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:14.160304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:14.160842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:14.161690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:14.162258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:14.284569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:14.292359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5175cdf9-acf7-421c-9876-3b1d6f5ee5f7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143323 Oct 28 15:34:14.293078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 518/995] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:14.641540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:14.642258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:14.648184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:14.648660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:14.649417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:14.649845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:14.691680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:14.692119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:14.692684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lazy-loading 'fault' on Instance uuid 66b317ef-28ae-443d-9981-0dc1561cdcab {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:34:14.734894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2d6e911eb44e8a93f98349f0a07568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467a52d2070d47d0ad9109b96bdd6f8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:14.742127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-10dbef45-c624-4f0b-8ff3-2a04d98cd257 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 200 len: 1349 microversion: 2.1 time: 0.105414 Oct 28 15:34:14.743111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 478/996] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:14 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:15.311119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:15.311756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:15.318340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:15.318774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:15.319525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:15.319947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:15.440843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:15.448410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5a7d11cf-109a-4e0f-ba13-27005edfed5f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141355 Oct 28 15:34:15.448964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 519/997] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:15 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:15.758756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:15.759351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] [instance: 66b317ef-28ae-443d-9981-0dc1561cdcab] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:15.765801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:15.766241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:15.766993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:15.767418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:15.780680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] HTTP exception thrown: Instance 66b317ef-28ae-443d-9981-0dc1561cdcab could not be found. Oct 28 15:34:15.781423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Returning 404 to user: Instance 66b317ef-28ae-443d-9981-0dc1561cdcab could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:34:15.782232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f06d8922-8859-4fea-917a-6daa88eb2f1f tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab" status: 404 len: 111 microversion: 2.1 time: 0.027122 Oct 28 15:34:15.782738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 479/998] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:15 2021] GET /compute/v2.1/servers/66b317ef-28ae-443d-9981-0dc1561cdcab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:34:15.790724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-20239264-5770-4d33-8c72-7619dd458b26 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] Calling method '.version_select at 0x7fdc12e38af0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:15.883667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-20239264-5770-4d33-8c72-7619dd458b26 tempest-TestMinimumBasicScenario-1142336569 tempest-TestMinimumBasicScenario-1142336569-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1268459958" status: 202 len: 0 microversion: 2.1 time: 0.096641 Oct 28 15:34:15.884239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 520/999] 10.222.0.86 () {58 vars in 1271 bytes} [Thu Oct 28 15:34:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1268459958 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:34:16.465202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:16.465687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:16.471513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:16.471958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:16.472754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:16.473221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:16.591903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:16.599644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aae91d93-792a-486d-b265-27b93e671fed tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138480 Oct 28 15:34:16.600435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 480/1000] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:17.616661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:17.617276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:17.622984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:17.623429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:17.624192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:17.624648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:17.747396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:17.757667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0a379d59-6fff-4820-9ed2-b927c3afadef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145048 Oct 28 15:34:17.758234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 521/1001] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:18.774980 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:18.775701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:18.783063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:18.786724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:18.786724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:18.786724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:18.915133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:18.926713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-12bfdb76-2ca9-4603-a494-0a4ef59c7d64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.155302 Oct 28 15:34:18.927284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 481/1002] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:19.943810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:19.944564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:19.956078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:19.956078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:19.956078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:19.956078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:20.072349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:20.080291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-87253f67-7d1d-4dc3-ae9d-e2c5cf73b087 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140145 Oct 28 15:34:20.080888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 522/1003] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:20.252666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:34:20.252825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:34:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:34:20.611140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:34:20.611648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:34:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:34:21.097299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:21.098053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:21.104695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:21.105381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:21.108484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:21.108484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:21.280411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:21.280411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d249c5d9-2cf2-4974-8059-9cf200631d62 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.168108 Oct 28 15:34:21.280411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 482/1004] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:22.287307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:22.288030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:22.294408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:22.294954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:22.295720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:22.296146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:22.424818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:22.433923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b682d2a7-e96f-42ed-8c0c-f54b74e96190 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.150273 Oct 28 15:34:22.439668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 523/1005] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:23.451242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:23.451895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:23.458578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:23.459338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:23.460367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:23.461050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:23.596047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:23.606052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5a793bbc-ea88-4f8a-adb0-8396c39f44bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.158880 Oct 28 15:34:23.606815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 483/1006] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:23 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:24.622334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:24.622915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:24.629080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:24.629522 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:24.630282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:24.630715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:24.753589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:24.761392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bdf8e8f7-9a26-48eb-8461-46fcd33a3e09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142793 Oct 28 15:34:24.761953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 524/1007] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:25.778759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:25.779354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:25.785730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:25.786171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:25.786972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:25.787480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:25.913969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:25.922645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-522c409e-d2a9-4c2c-9045-77f7476f5932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147464 Oct 28 15:34:25.923206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 484/1008] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:26.945135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:26.946985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:26.962939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:26.963475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:26.964318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:26.964840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:27.103196 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:27.110894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0477871f-991a-4fa3-a8d9-32943e989af6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.175153 Oct 28 15:34:27.111448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 525/1009] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:26 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:28.127788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:28.128408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:28.134608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:28.135040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:28.135787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:28.136210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:28.253235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:28.260814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aa890852-bb33-4603-8fea-32c7cd381c45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136659 Oct 28 15:34:28.261375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 485/1010] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:29.277724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:29.278252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:29.285033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:29.285467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:29.286231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:29.286654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:29.403337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:29.411472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-34fed56f-6db4-47de-93f4-58595056c47a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137463 Oct 28 15:34:29.412026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 526/1011] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:30.428924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:30.429529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:30.435845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:30.436293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:30.437083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:30.437509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:30.561412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:30.567719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a0928874-15e4-4635-839f-81775a49b452 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143442 Oct 28 15:34:30.568273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 486/1012] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:31.584555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:31.585156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:31.592013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:31.592465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:31.593215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:31.593639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:31.709988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:31.718131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-05145967-cc08-4f02-9053-2593a6430ac2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137264 Oct 28 15:34:31.718679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 527/1013] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:32.735353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:32.735947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:32.742146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:32.743011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:32.743332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:32.743757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:32.862509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:32.870288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5492474b-13a0-429b-85cd-c27a7e4341d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139186 Oct 28 15:34:32.871034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 487/1014] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:33.891541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:33.892142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:33.898339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:33.898770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:33.899519 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:33.899933 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:34.021873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:34.030018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8eeea563-3b84-4aa0-b08d-6500371d34be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142287 Oct 28 15:34:34.030572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 528/1015] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:35.046555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:35.047151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:35.053444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:35.053887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:35.054689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:35.055115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:35.172095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:35.179662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d7abb561-6a4a-48cd-9e85-5ec2d410673d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136725 Oct 28 15:34:35.180223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 488/1016] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:36.196625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:36.197227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:36.203829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:36.204271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:36.205055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:36.205487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:36.323182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:36.331652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1af51960-c375-46c6-b538-e62f61011b20 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138751 Oct 28 15:34:36.332202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 529/1017] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:36 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:37.348380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:37.348931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:37.355219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:37.355660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:37.356449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:37.356888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:37.485859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:37.493480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5362f00d-7ac6-4bfd-a83e-09612a5a3c90 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148951 Oct 28 15:34:37.494061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 489/1018] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:38.510921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:38.511524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:38.518049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:38.518495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:38.519249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:38.519670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:38.635829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:38.644214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fcb7ba69-85dd-4ba5-99bb-c209876ac2c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137178 Oct 28 15:34:38.644794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 530/1019] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:38 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:39.660912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:39.661516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:39.667430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:39.667868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:39.668648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:39.669075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:39.787960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:39.796107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a450f29e-9398-4018-a5c5-ca4416a12c9a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138774 Oct 28 15:34:39.796701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 490/1020] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:40.812823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:40.813361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:40.819630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:40.820066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:40.820847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:40.821275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:40.960032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:40.967659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cc00c585-0700-4fd4-9a81-7bee577e8aa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.159111 Oct 28 15:34:40.968200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 531/1021] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:41.985459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:41.986084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:41.992370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:41.992847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:41.993606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:41.994039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:42.115615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:42.123740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9b7d48d2-73f1-4e77-8d92-88961db79cc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142711 Oct 28 15:34:42.124438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 491/1022] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:41 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:43.140791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:43.141397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:43.147588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:43.148025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:43.148814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:43.149233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:43.281229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:43.288986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f6823bd6-4f0d-49ad-8e74-2f74dd791a89 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152090 Oct 28 15:34:43.289540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 532/1023] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:44.306496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:44.307103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:44.313884 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:44.314324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:44.315086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:44.315513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:44.443816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:44.451553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-17571ff5-8d1e-41ed-a344-1c45cd064a6a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148916 Oct 28 15:34:44.452105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 492/1024] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:44 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:45.468270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:45.468915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:45.475154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:45.475583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:45.476331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:45.476778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:45.593849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:45.601485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3cdb1210-eddb-4e44-ba5a-c007449171e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136829 Oct 28 15:34:45.602035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 533/1025] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:45 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:46.618024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:46.618643 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:46.624919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:46.625360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:46.626114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:46.626545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:46.745071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:46.752856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b1428718-ecd9-4196-901e-5efa1423699e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138438 Oct 28 15:34:46.753413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 493/1026] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:47.770417 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:47.770961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:47.777146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:47.777589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:47.778352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:47.779117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:47.902043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:47.909850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c29dff82-9309-4864-9797-31f32f4b710c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143565 Oct 28 15:34:47.910450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 534/1027] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:48.926747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:48.927389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:48.933516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:48.933963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:48.935306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:48.935735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:49.053581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:49.062010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-31fb5886-2f53-4bff-8051-3848fb22d8d7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138803 Oct 28 15:34:49.062696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 494/1028] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:48 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:50.079391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:50.079989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:50.086113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:50.086543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:50.087293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:50.087710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:50.206622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:50.214288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a19b1e6f-4d45-4167-bc66-70caaf201b13 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139085 Oct 28 15:34:50.214831 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 535/1029] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:51.230942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:51.231500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:51.237554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:51.237992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:51.238745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:51.239173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:51.359650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:51.367288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-96552151-5365-4977-afeb-a77177b75530 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140135 Oct 28 15:34:51.367843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 495/1030] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:51 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:52.384617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:52.385192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:52.392297 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:52.394990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:52.394990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:52.394990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:52.518475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:52.526527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-96a5d76c-6aee-4117-82bc-acd8b101eb21 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145743 Oct 28 15:34:52.527162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 536/1031] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:53.543551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:53.544144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:53.550919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:53.551359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:53.552116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:53.552575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:53.669694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:53.677941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-edc2bc7c-926e-44f0-832b-d82416284565 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138095 Oct 28 15:34:53.678502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 496/1032] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:53 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:54.694727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:54.695328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:54.701484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:54.701918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:54.702659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:54.703074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:54.823846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:54.831639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-77612ae2-4020-474b-9aba-4089b695007c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140532 Oct 28 15:34:54.832193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 537/1033] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:55.847900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:55.848527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:55.854649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:55.855076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:55.855825 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:55.856247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:55.975607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:55.983195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ed48dc0e-3935-4ea6-8d02-d0e7fc065107 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138923 Oct 28 15:34:55.983747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 497/1034] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:55 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:56.999612 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:57.000148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:57.006291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:57.006724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:57.007481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:57.007903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:57.124513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:57.132546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-efed4243-68f4-4391-8867-fb259382a9ca tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136509 Oct 28 15:34:57.133100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 538/1035] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:58.149783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:58.150380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:58.156471 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:58.156906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:58.157779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:58.158204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:58.283919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:58.291543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e30226cf-ecac-4925-9551-db74b70a7d7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145322 Oct 28 15:34:58.292099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 498/1036] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:58 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:34:59.308602 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:34:59.309135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:34:59.315679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:59.316108 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:59.316874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:34:59.317293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:34:59.436165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:34:59.444640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-43baab05-8ae5-44b5-96d3-7a06d48910c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139655 Oct 28 15:34:59.445200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 539/1037] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:34:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:00.461032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:00.461646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:00.467971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:00.468432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:00.469209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:00.469659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:00.594052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:00.597499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0cfa671e-fe2a-4953-a3c9-ccb574dccfa9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140093 Oct 28 15:35:00.598064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 499/1038] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:00 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:01.614684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:01.615286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:01.621438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:01.621877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:01.622626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:01.623050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:01.743530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:01.751240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-937e68fa-0dc4-4e3e-b811-be4c86971627 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140755 Oct 28 15:35:01.751798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 540/1039] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:02.767717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:02.768324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:02.774529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:02.774969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:02.775722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:02.776147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:02.892926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:02.900623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-62d69281-f63f-4f94-b8db-9540a7704295 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136733 Oct 28 15:35:02.901177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 500/1040] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:02 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:03.918300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:03.918902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:03.925041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:03.925473 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:03.926724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:03.927148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:04.042970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:04.050646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eb572fbc-f34e-4d28-9c37-c904a770c436 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135951 Oct 28 15:35:04.051816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 541/1041] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:03 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:05.069182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:05.069778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:05.076042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:05.076530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:05.077283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:05.077707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:05.196766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:05.204305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-38450bc3-bec0-4926-abb4-2b4094b41f31 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139594 Oct 28 15:35:05.204897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 501/1042] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:06.221617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:06.222221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:06.229040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:06.229482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:06.230233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:06.230654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:06.349496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:06.357190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f883e760-e2ed-4ff3-a8db-0f0fcba12469 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139231 Oct 28 15:35:06.358029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 542/1043] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:07.373554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:07.374158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:07.380911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:07.381100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:07.381983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:07.382414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:07.500917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:07.508431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-35996bf4-c055-4968-b578-c99c7973e25c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138538 Oct 28 15:35:07.508979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 502/1044] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:08.525287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:08.525892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:08.531586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:08.532032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:08.532822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:08.533248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:08.652491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:08.659941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7d9e84c5-81f9-40e6-8686-7154609bc9cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138417 Oct 28 15:35:08.660502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 543/1045] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:08 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:09.677038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:09.677643 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:09.693000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:09.693439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:09.694365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:09.694904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:09.821923 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:09.829601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f1b0c7f9-4e12-4473-9f67-c68807f4cfd3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.156439 Oct 28 15:35:09.830156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 503/1046] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:10.846796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:10.847423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:10.854306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:10.854747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:10.855500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:10.855927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:10.974517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:10.982490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dac3860f-d046-4f6e-816d-23056902db45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139325 Oct 28 15:35:10.983028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 544/1047] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:11.998979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:11.999605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:12.006377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:12.006810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:12.007554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:12.007973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:12.149808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:12.157423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bdacf620-93dd-408a-a0ab-c240ef5b80b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.162106 Oct 28 15:35:12.157978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 504/1048] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:13.173553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:13.174162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:13.180570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:13.181034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:13.181778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:13.182205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:13.297851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:13.305423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e5a1e2a8-c4c8-44d6-a5d3-379c3d0d71bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135530 Oct 28 15:35:13.305976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 545/1049] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:13 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:14.321970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:14.322566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:14.328808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:14.329248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:14.330000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:14.330424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:14.446927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:14.454661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5502129a-768b-464e-bf79-fd136a5b5f9e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136306 Oct 28 15:35:14.455220 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 505/1050] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:35:15.471920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:15.472554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:15.479399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:15.479838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:15.480639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:15.481065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:15.600898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:15.608702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-98ada997-e36a-47d0-958a-7f1fefe20e39 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140454 Oct 28 15:35:15.609254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 546/1051] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:15 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:16.625494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:16.626053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:16.632180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:16.632648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:16.633402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:16.633862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:16.751978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:16.759836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0b1ace23-c4ef-4f46-93a6-b6f70151d700 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138018 Oct 28 15:35:16.760420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 506/1052] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:17.779917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:17.788999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:17.790717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:17.793534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:17.794325 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:17.795045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:17.919110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:17.926682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6510e6e4-a2fe-46ec-8681-dd57cf715fcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152977 Oct 28 15:35:17.927229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 547/1053] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:18.942539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:18.943759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:18.949950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:18.950383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:18.951129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:18.951551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:19.073274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:19.080931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e4fdee2a-b1c7-4c26-b80d-9757d448975e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141961 Oct 28 15:35:19.081492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 507/1054] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:20.096992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:20.097504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:20.103609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:20.104041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:20.104819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:20.105236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:20.229668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:20.237742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9b8d2aca-eb3c-4d62-8f84-766c498040c2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144418 Oct 28 15:35:20.238293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 548/1055] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:20 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:21.253974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:21.254537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:21.260664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:21.261103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:21.261856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:21.262283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:21.378625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:21.386154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-82d4fe67-8674-4240-aedc-7167de9c1931 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135928 Oct 28 15:35:21.386708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 508/1056] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:22.404116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:22.405086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:22.411329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:22.412307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:22.413169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:22.413598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:22.545475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:22.553892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1092c970-55e7-4e70-8d7a-783b84207471 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.153536 Oct 28 15:35:22.554595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 549/1057] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:23.570383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:23.571148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:23.577153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:23.577597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:23.578360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:23.578790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:23.704346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:23.712797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a4896f4a-89cc-4cc2-ab06-90bbf0887bcd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145910 Oct 28 15:35:23.713361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 509/1058] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:23 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:24.729656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:24.730264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:24.736469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:24.736912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:24.737703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:24.738131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:24.859252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:24.867034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5813e271-af4a-4adf-b399-e27005c50c93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140996 Oct 28 15:35:24.867596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 550/1059] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:25.882909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:25.883481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:25.889963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:25.890403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:25.891157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:25.891585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:26.010676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:26.018881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2e26f669-6f23-4524-8bff-b0aa6e6fee46 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139738 Oct 28 15:35:26.019441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 510/1060] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:27.035893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:27.036996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:27.043129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:27.043566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:27.044318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:27.044782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:27.162592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:27.170365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0f31e488-24ba-41a2-8ff4-d708faf14b0e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138097 Oct 28 15:35:27.170924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 551/1061] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:27 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:28.187008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:28.187613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:28.194704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:28.195149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:28.195910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:28.196339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:28.327044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:28.335001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d1b9ffa-9773-439e-b165-cbc3a1f8ca80 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.151609 Oct 28 15:35:28.335555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 511/1062] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:29.351451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:29.352044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:29.359410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:29.359958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:29.360628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:29.361051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:29.482701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:29.490516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-29575f14-6c91-4541-ae30-c55e62d0ad03 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142678 Oct 28 15:35:29.491063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 552/1063] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:30.506945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:30.507524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:30.513620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:30.514054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:30.515055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:30.515475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:30.633443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:30.641320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4df5430f-a77c-463d-8e3a-5ed93f3d3733 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138019 Oct 28 15:35:30.641875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 512/1064] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:31.658044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:31.658666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:31.664860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:31.665348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:31.666048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:31.666468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:31.784106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:31.791797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ee525f4e-d40c-4d9d-8241-38308cca8016 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137476 Oct 28 15:35:31.792355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 553/1065] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:32.808762 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:32.952543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:32.952543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:32.952543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:32.952543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:32.954486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:32.954486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:32.954486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-accc897a-9d0f-43de-aa30-37403a6b1e7b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145565 Oct 28 15:35:32.954486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 513/1066] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:33.967302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:33.967940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:33.974099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:33.974536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:33.975298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:33.975739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:34.093853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:34.109348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dbcac301-fe3a-4259-91d0-36abfef02766 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145653 Oct 28 15:35:34.109910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 554/1067] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:35.126452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:35.127055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:35.133212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:35.133657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:35.134424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:35.134855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:35.251594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:35.259271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-74fbfd9a-285f-4f52-8da3-22a16f4b6649 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136486 Oct 28 15:35:35.259819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 514/1068] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:36.275360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:36.275956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:36.282295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:36.282718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:36.283454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:36.283868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:36.408275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:36.416511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d5d367c2-a7bd-45e2-832d-2788502bdb74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145042 Oct 28 15:35:36.417069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 555/1069] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:36 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:37.433551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:37.434156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:37.440374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:37.440853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:37.441614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:37.442045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:37.557714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:37.565355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c86cb8e8-bcc7-477f-b33c-639eada610bd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135418 Oct 28 15:35:37.565907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 515/1070] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:38.582147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:38.582703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:38.588926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:38.589363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:38.590130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:38.590554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:38.706073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:38.714365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1abbaedb-627e-432a-9980-7b7ffe7050d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136037 Oct 28 15:35:38.714923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 556/1071] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:38 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:39.734474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:39.735622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:39.743153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:39.743603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:39.744374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:39.744824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:39.867812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:39.875561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5f1fe211-941a-4a0f-8980-7ee312697e55 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146712 Oct 28 15:35:39.876062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 516/1072] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:40.892751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:40.893351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:40.899590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:40.906268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:40.906268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:40.906268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:41.021159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:41.030912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62aef1b2-e8cf-467c-bb3b-f31b675ac570 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141628 Oct 28 15:35:41.031508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 557/1073] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:42.048602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:42.049191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:42.058638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:42.059077 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:42.059950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:42.060410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:42.182832 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:42.190391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-67db2e42-bfbd-4669-ab08-c9ef698c957a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145673 Oct 28 15:35:42.190943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 517/1074] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:42 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:43.208048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:43.208662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:43.216109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:43.216820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:43.217828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:43.218599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:43.346219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:43.354649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-34a2eb6b-7f94-4da1-aa1e-43c05654071b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.150235 Oct 28 15:35:43.355214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 558/1075] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:44.372367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:44.372953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:44.380123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:44.380599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:44.381350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:44.381768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:44.497908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:44.505500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4a2c3ead-b3e1-4f19-b5b7-833481360afa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136837 Oct 28 15:35:44.506047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 518/1076] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:44 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:45.522513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:45.523122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:45.529301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:45.529739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:45.530497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:45.530923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:45.647920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:45.655814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6013f750-f301-48ae-b92e-b32705eb3e8e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136976 Oct 28 15:35:45.656373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 559/1077] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:45 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:46.672947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:46.673563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:46.679786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:46.680787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:46.681546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:46.681975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:46.808403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:46.816081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8a76af8d-87ae-437d-af78-45e8e99c4b57 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146789 Oct 28 15:35:46.816679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 519/1078] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:47.832691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:47.833298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:47.839467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:47.839899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:47.840669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:47.841093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:47.957084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:47.965153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-77118826-48cd-4d40-9894-f7b9d145175a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136172 Oct 28 15:35:47.965705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 560/1079] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:48.980978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:48.981580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:48.987724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:48.988162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:48.988956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:48.989379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:49.109705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:49.118180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3937b99a-05bf-47e2-9e55-43a69108c2ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140191 Oct 28 15:35:49.118750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 520/1080] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:48 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:50.135424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:50.135963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:50.142362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:50.142801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:50.143556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:50.143982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:50.477247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:50.484965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c38fa428-73f2-4d97-9229-8b3637474a60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.353801 Oct 28 15:35:50.485507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 561/1081] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:51.503373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:51.503993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:51.511226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:51.511669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:51.512466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:51.512899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:51.630470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:51.638541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f0d4fa2a-9ff6-4acf-97eb-537a1f8d9b45 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139476 Oct 28 15:35:51.639109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 521/1082] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:51 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:52.655363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:52.655928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:52.662117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:52.662554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:52.663306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:52.663726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:52.781768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:52.790068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c3fafda6-624b-4ed4-bc90-6460aea58a38 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138443 Oct 28 15:35:52.791762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 562/1083] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:53.806463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:53.807062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:53.813273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:53.813713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:53.814465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:53.814898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:53.934355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:53.941971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4626bf8a-1429-4d41-b8e4-21c7175faefc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139108 Oct 28 15:35:53.942528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 522/1084] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:53 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:54.959080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:54.959707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:54.966348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:54.966779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:54.967517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:54.967935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:55.083814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:55.092312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f07c9fcb-e90a-4257-a090-6dc2dd8fe0de tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136841 Oct 28 15:35:55.093194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 563/1085] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:56.110813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:56.111423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:56.118257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:56.118695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:56.119458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:56.119888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:56.237807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:56.245374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8894e111-283b-4027-9d2c-57d84e38ffbe tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138158 Oct 28 15:35:56.245931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 523/1086] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:57.263624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:57.264643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:57.270919 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:57.271401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:57.272376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:57.272899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:57.396010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:57.404518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-49b98385-bea3-448b-9b92-5ed98db288ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144634 Oct 28 15:35:57.405084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 564/1087] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:57 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:57.618191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:57.619616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:57.625791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:57.626443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:57.627212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:57.627667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:57.652424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:35:57.986372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9b84efe0-666e-45cf-8949-fb5cef5a7677 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 204 len: 0 microversion: 2.20 time: 0.371766 Oct 28 15:35:57.986947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 524/1088] 10.222.0.86 () {60 vars in 1279 bytes} [Thu Oct 28 15:35:57 2021] DELETE /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 15:35:57.995321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:57.995854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:58.001655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:58.004496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:58.004496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:58.004496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:58.121885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:58.129447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:58.130938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:58.132062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0b359faa-e14a-4c7a-8ff7-899bd89b5917 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1723 microversion: 2.20 time: 0.140997 Oct 28 15:35:58.132622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 565/1089] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:35:57 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:35:58.421659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:58.422386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:58.428162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:58.428652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:58.430069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:58.430506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:58.551708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:58.559453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bea6d201-16ac-4d73-8c7f-cc141ab4019a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141813 Oct 28 15:35:58.560009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 525/1090] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:58 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:59.153351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:59.153922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:59.159991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:59.160449 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:59.161411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:59.161830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:59.287510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:59.305044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:59.305044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:59.305044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3956f7bd-342a-44f8-9fbe-91000201ad7e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1723 microversion: 2.20 time: 0.152482 Oct 28 15:35:59.312990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 566/1091] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:35:59 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:35:59.576823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:35:59.577412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:35:59.583477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:59.583920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:59.584698 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:59.585122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:59.705355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:35:59.713555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b0cafbb5-df6e-4bb5-b0e5-a45ddda81a24 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140262 Oct 28 15:35:59.714311 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 526/1092] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:35:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:35:59.761132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-bae3958a-e5dd-4508-b74d-b3219ab3d8fa req-d57e6882-13cf-4a60-9952-1ed2fb484bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b1113c-fcf2-4a62-962c-98c13d3fbb28", "name": "network-vif-deleted", "tag": "2af929d2-70e7-4606-bf03-5b2151449c8d"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:35:59.761583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:35:59.761583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:35:59.768859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-bae3958a-e5dd-4508-b74d-b3219ab3d8fa req-d57e6882-13cf-4a60-9952-1ed2fb484bfc service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:35:59.769279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-bae3958a-e5dd-4508-b74d-b3219ab3d8fa req-d57e6882-13cf-4a60-9952-1ed2fb484bfc service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:35:59.780113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-bae3958a-e5dd-4508-b74d-b3219ab3d8fa req-d57e6882-13cf-4a60-9952-1ed2fb484bfc service nova] Creating event network-vif-deleted:2af929d2-70e7-4606-bf03-5b2151449c8d for instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 on hv-cinder-78364 Oct 28 15:35:59.785516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-bae3958a-e5dd-4508-b74d-b3219ab3d8fa req-d57e6882-13cf-4a60-9952-1ed2fb484bfc service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Oct 28 15:35:59.786410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 567/1093] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:35:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:36:00.317164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:00.317891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:00.324021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:00.324840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:00.325650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:00.326084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:00.359890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:00.360477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:00.360996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lazy-loading 'fault' on Instance uuid e2b1113c-fcf2-4a62-962c-98c13d3fbb28 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:36:00.402519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:00.410348 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:00.411822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e40ffcd9186b49bf9326b1f2c8efe7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1cee9c314942b8b8e9be0c40ec04f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:00.412995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d7830eea-fa47-4f1a-89cd-12ecea598b6e tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 200 len: 1371 microversion: 2.20 time: 0.099683 Oct 28 15:36:00.413859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 527/1094] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:36:00 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 15:36:00.730992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:00.731692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:00.739079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:00.742105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:00.742105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:00.742105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:00.863038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:00.871422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2f9f045f-18b4-4fc7-9857-9bec8bf2f560 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144563 Oct 28 15:36:00.871978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 568/1095] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:00 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:01.431254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:01.431851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:01.437858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:01.438285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:01.439033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:01.439453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:01.452277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. Oct 28 15:36:01.452877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:36:01.453695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5503db60-36e2-444b-9bb4-9318de9ef78c tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 404 len: 111 microversion: 2.20 time: 0.026667 Oct 28 15:36:01.454191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 528/1096] 10.222.0.86 () {60 vars in 1276 bytes} [Thu Oct 28 15:36:01 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:36:01.462560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b532996a-2ded-45a0-921c-ffb01dc4716a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '.version_select at 0x7fdc12d6e8b0>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:01.577627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b532996a-2ded-45a0-921c-ffb01dc4716a tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101645175" status: 204 len: 0 microversion: 2.20 time: 0.119068 Oct 28 15:36:01.578223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 569/1097] 10.222.0.86 () {60 vars in 1258 bytes} [Thu Oct 28 15:36:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101645175 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 15:36:01.888938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:01.889851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:01.895581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:01.896022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:01.896815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:01.897244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:02.128849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:02.136628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4e7d7618-a60c-4a38-8178-34bd42674c6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.251422 Oct 28 15:36:02.137189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 529/1098] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:03.153802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:03.154400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:03.160231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:03.160659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:03.161404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:03.161821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:03.283621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:03.291771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d94153de-2141-4efb-a890-1ecf98ad5fff tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142591 Oct 28 15:36:03.292318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 570/1099] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:03 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:04.308688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:04.309287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:04.315398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:04.315834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:04.316612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:04.317035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:04.436174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:04.443793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c0fadafd-411a-432b-a9f9-362017938a17 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139417 Oct 28 15:36:04.444352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 530/1100] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:04 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:05.460612 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:05.461222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:05.467264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:05.467693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:05.468454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:05.468876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:05.586016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:05.594123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e4fc4bfe-481e-4639-b5cd-04a71b3a5b49 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137195 Oct 28 15:36:05.594834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 571/1101] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:06.610729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:06.611443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:06.617594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:06.618036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:06.618791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:06.619216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:06.746705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:06.754646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3e7d857a-2bb3-4c2b-a070-3612f4f45432 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147515 Oct 28 15:36:06.755226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 531/1102] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:07.771874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:07.772314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:07.778873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:07.779267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:07.780022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:07.780485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:07.899784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:07.907411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-97579a64-c6a6-4b50-8615-bea224f45263 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139153 Oct 28 15:36:07.907967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 572/1103] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:08.923752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:08.924363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:08.931042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:08.931488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:08.932263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:08.932729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:09.048577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:09.056166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-13fd2d0f-316c-4aa5-b605-82450fb9320f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136002 Oct 28 15:36:09.056757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 532/1104] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:08 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:10.073064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:10.073618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:10.079820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:10.080253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:10.081059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:10.081477 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:10.202992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:10.210509 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d7084660-935d-4bfc-9c59-92b89e5bea96 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141309 Oct 28 15:36:10.211060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 573/1105] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:36:11.227649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:11.228251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:11.234478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:11.234914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:11.235671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:11.236094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:11.367865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:11.376026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e4098f5d-b68f-4230-876d-ded06e78f777 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.153021 Oct 28 15:36:11.376612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 533/1106] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:12.393909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:12.394438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:12.400735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:12.401177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:12.401936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:12.402363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:12.519554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:12.527433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-932e8008-2d09-4f8e-9bae-330a0888e3da tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137328 Oct 28 15:36:12.527991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 574/1107] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:13.544188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:13.544821 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:13.551215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:13.551660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:13.552436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:13.552872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:13.673080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:13.681124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7dba8a04-ee56-44bb-bffa-7b861451b75c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140026 Oct 28 15:36:13.681679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 534/1108] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:13 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:14.698613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:14.699203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:14.705518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:14.705954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:14.706707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:14.707132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:14.827064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:14.834584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d7c46b5e-3fce-49f2-ae05-b6090ed20d1f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140429 Oct 28 15:36:14.835129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 575/1109] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:15.851899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:15.853061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:15.859560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:15.859999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:15.860793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:15.861222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:15.979239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:15.987041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4f760171-bb48-4e86-91b2-70d7418aab59 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138890 Oct 28 15:36:15.987597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 535/1110] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:15 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:17.003697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:17.004234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:17.010881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:17.011310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:17.012053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:17.012499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:17.132265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:17.140844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-56064eb3-e6e1-43c3-820a-1adaec61029b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140827 Oct 28 15:36:17.141387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 576/1111] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:18.158295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:18.158899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:18.165858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:18.166301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:18.167060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:18.167481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:18.291638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:18.299328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ff4d37ea-b2b0-460c-8e62-82f73b3fa69b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144601 Oct 28 15:36:18.299869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 536/1112] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:19.319743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:19.319743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:19.323833 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:19.324281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:19.325055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:19.325472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:19.445639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:19.453246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-de56834d-544d-4239-8617-6f09e5c03de0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140348 Oct 28 15:36:19.453802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 577/1113] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:20.470358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:20.470958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:20.477087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:20.477526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:20.478279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:20.478706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:20.598086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:20.606285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d1f8ded-b0ef-4228-a639-4e07b51b0ecc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139540 Oct 28 15:36:20.606838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 537/1114] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:20 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:21.623444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:21.623988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:21.630069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:21.630501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:21.631243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:21.631662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:21.753096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:21.765309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f1179141-dcb1-454c-96fe-3b8c9eb89148 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145962 Oct 28 15:36:21.765868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 578/1115] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:22.781719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:22.782321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:22.788556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:22.795718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:22.795718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:22.795718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:22.907628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:22.915199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-76b48c6a-b788-4ad7-84bf-a64d8bd9656e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137163 Oct 28 15:36:22.916281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 538/1116] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:23.932917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:23.933528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:23.939698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:23.940140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:23.940930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:23.941359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:24.061484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:24.069168 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-217ed1ef-92b5-415a-8cdd-965a48b0cf64 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140418 Oct 28 15:36:24.069719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 579/1117] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:23 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:25.086568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:25.087919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:25.094337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:25.094781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:25.095543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:25.095975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:25.211009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:25.219263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1d00243a-e90a-4dc8-bfea-3faf32c535fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136442 Oct 28 15:36:25.219820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 539/1118] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:26.236355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:26.236976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:26.243141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:26.243580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:26.244332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:26.244782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:26.360940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:26.369219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-77cdc24c-5b34-45f0-a11c-1527cde932d3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136575 Oct 28 15:36:26.369779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 580/1119] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:26 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:27.386044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:27.386606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:27.393235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:27.393682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:27.394441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:27.394871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:27.515546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:27.523194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1cc27ffe-31a4-4067-a18e-615c06668a76 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140953 Oct 28 15:36:27.523758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 540/1120] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:27 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:28.539840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:28.540466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:28.546660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:28.547098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:28.547853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:28.548280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:28.665814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:28.673537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5e8d6ec5-9bd8-46b2-84af-59eb4dccf094 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137310 Oct 28 15:36:28.674097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 581/1121] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:29.690652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:29.691241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:29.697563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:29.698005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:29.698802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:29.699235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:29.822976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:29.831045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-45db10dd-7631-4bab-90fb-4b3aa321600b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143858 Oct 28 15:36:29.831602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 541/1122] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:30.848320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:30.848952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:30.855086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:30.855516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:30.856273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:30.856728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:30.977875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:30.986096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c7210a94-d325-446e-a5d9-5445ec1ddb4f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141406 Oct 28 15:36:30.986640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 582/1123] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:32.002707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:32.003242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:32.009362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:32.009804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:32.010553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:32.010979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:32.126955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:32.134521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-18df3b50-819c-4132-bc25-71f2c08e3431 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135558 Oct 28 15:36:32.135069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 542/1124] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:33.151891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:33.152425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:33.159322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:33.159781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:33.160559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:33.160980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:33.276457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:33.284569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-54782aee-b73c-4bfd-944a-d98f6ae70b7a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136318 Oct 28 15:36:33.285120 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 583/1125] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:34.302120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:34.302667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:34.308792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:34.309257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:34.310012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:34.310475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:34.430953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:34.438558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4b8cefc3-0189-4fe9-86a6-08e3160e14ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140367 Oct 28 15:36:34.439106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 543/1126] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:34 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:35.455349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:35.457139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:35.461920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:35.462355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:35.463100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:35.463521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:35.580438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:35.588223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-97fccfdb-6700-4bc8-9119-8cbe659aa5a5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137029 Oct 28 15:36:35.588848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 584/1127] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:36.605990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:36.606577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:36.612844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:36.613285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:36.614046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:36.614475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:36.734661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:36.738645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6f4764bd-9015-4223-aef7-a07be8b71c10 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136257 Oct 28 15:36:36.739207 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 544/1128] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:36 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:37.756078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:37.756724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:37.762476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:37.762912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:37.764438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:37.764867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:38.044824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:38.052426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-331c46a8-0d36-4234-9a59-f52833ed9923 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.300143 Oct 28 15:36:38.052976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 585/1129] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:39.069791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:39.070328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:39.076120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:39.076598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:39.077352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:39.077807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:39.196187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:39.204478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-290f016f-00b3-432d-8203-317ac7e422af tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138454 Oct 28 15:36:39.205042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 545/1130] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:40.221446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:40.222123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:40.228347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:40.228822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:40.229580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:40.230048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:40.350843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:40.358582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f854ae3b-4012-43d2-ae99-8b338177edc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140765 Oct 28 15:36:40.359129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 586/1131] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:41.375186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:41.375779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:41.381855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:41.382285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:41.383029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:41.383451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:41.515770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:41.523367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4f2c6f09-32cf-47be-b752-70c3080db4ec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152296 Oct 28 15:36:41.523912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 546/1132] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:41 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:42.541023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:42.541023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:42.548070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:42.548547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:42.549444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:42.549864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:42.676496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:42.684415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-33a6b5f5-64df-4429-8984-4ea422465a35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148386 Oct 28 15:36:42.684984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 587/1133] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:42 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:43.700877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:43.701470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:43.707613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:43.708050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:43.708839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:43.709267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:43.842111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:43.849950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-43145803-ebdd-4a24-acfd-6dc346a66a43 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152743 Oct 28 15:36:43.850510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 547/1134] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:44.866880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:44.867492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:44.873610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:44.874047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:44.874797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:44.875218 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:44.993546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:45.001138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-70d8b1b0-342c-4b52-8f66-fc3511184fc9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137944 Oct 28 15:36:45.001684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 588/1135] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:44 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:46.016994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:46.017600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:46.023778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:46.024224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:46.025023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:46.025451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:46.145026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:46.152703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-29e2a3e2-c857-4dfa-9ecb-e3e68b8c6216 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139609 Oct 28 15:36:46.153261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 548/1136] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:47.169307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:47.169897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:47.176018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:47.176494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:47.177246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:47.177671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:47.294979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:47.303029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a376dd72-0fd5-4a05-99bc-f5e60213a279 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137375 Oct 28 15:36:47.303589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 589/1137] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:48.320234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:48.320850 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:48.327504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:48.327937 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:48.328712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:48.329134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:48.447287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:48.455390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7a597fc8-8518-4128-a467-3f2ad44f02be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138799 Oct 28 15:36:48.455935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 549/1138] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:48 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:49.472434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:49.473072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:49.479270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:49.479708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:49.480487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:49.480916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:49.598703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:49.606864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-409086f8-152d-451c-a662-f7528d8a9011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137522 Oct 28 15:36:49.607434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 590/1139] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:49 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:50.623866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:50.624509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:50.630663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:50.631099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:50.631842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:50.632260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:50.751262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:50.759470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2bc0df2c-ac8f-47d1-876f-8150d3c8b58d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139881 Oct 28 15:36:50.760022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 550/1140] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:51.776539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:51.777131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:51.783439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:51.783877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:51.784678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:51.785107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:51.906413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:51.914361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e93bdaea-7a29-4b77-bafa-936a885dafdf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141433 Oct 28 15:36:51.915157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 591/1141] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:51 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:52.935284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:52.936307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:52.943288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:52.943785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:52.944587 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:52.945812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:53.066843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:53.074444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c0e909df-de05-4719-88dc-7036f9d19705 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145927 Oct 28 15:36:53.074996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 551/1142] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:54.090917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:54.091603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:54.097812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:54.098250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:54.099007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:54.099433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:54.216782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:54.224347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c82cfce7-2c95-493d-b424-a9e72ff1d3be tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137250 Oct 28 15:36:54.224920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 592/1143] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:55.241606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:55.242210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:55.248864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:55.249301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:55.250052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:55.250483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:55.368268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:55.375874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0173d64a-f199-44d5-b92b-2f841832351a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137834 Oct 28 15:36:55.376450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 552/1144] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:55 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:56.392840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:56.393368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:56.399464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:56.399897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:56.400677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:56.401099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:56.516888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:56.524514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-395c20be-c658-424d-a4b5-de3357f6373a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135285 Oct 28 15:36:56.525062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 593/1145] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:57.540838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:57.541421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:57.548168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:57.548640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:57.549391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:57.549815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:57.671962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:57.679585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-562f8680-82ee-48f4-9d17-d49a17530f5d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142371 Oct 28 15:36:57.680147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 553/1146] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:57 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:58.696302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:58.696935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:58.703113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:58.703553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:58.704313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:58.704765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:58.823514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:58.831184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8b9be399-2e4e-4bb3-b967-d781fcbb9b60 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138508 Oct 28 15:36:58.837496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 594/1147] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:58 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:36:59.847956 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:36:59.848614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:36:59.855319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:59.855743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:59.856531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:36:59.857079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:36:59.976893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:36:59.984992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b0dedc2b-a54c-44be-8214-bb55d2aa89bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140627 Oct 28 15:36:59.985541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 554/1148] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:36:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:01.011454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:01.011996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:01.019184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:01.019628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:01.020416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:01.020844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:01.136443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:01.144941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dfa8aaec-fe1a-4120-8dc2-22fa00216323 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137361 Oct 28 15:37:01.145501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 595/1149] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:02.161731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:02.162289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:02.168407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:02.168894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:02.169654 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:02.170081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:02.290275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:02.297885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-137d47fc-ab60-4799-8ee1-492c48cfe318 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139910 Oct 28 15:37:02.298439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 555/1150] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:02 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:03.314773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:03.315380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:03.321696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:03.322140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:03.322903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:03.323360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:03.441561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:03.449333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ea40f966-6520-429b-813c-21f88087edfd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138127 Oct 28 15:37:03.454771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 596/1151] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:03 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:04.466222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:04.466808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:04.472978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:04.473421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:04.474191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:04.474621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:04.593249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:04.600911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4a0ff005-232b-4492-86d9-db1a03b74f5b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138802 Oct 28 15:37:04.601467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 556/1152] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:04 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:05.617434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:05.618042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:05.624865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:05.625307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:05.626066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:05.626489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:05.758043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:05.766669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8855230d-6a07-4f31-a94a-eff30a669b77 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152924 Oct 28 15:37:05.767226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 597/1153] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:06.783754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:06.784356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:06.790544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:06.790983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:06.791737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:06.792160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:06.908595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:06.916154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8d099d54-b043-4af0-9b57-4b2b5bd1895b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136044 Oct 28 15:37:06.916777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 557/1154] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:07.933188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:07.933783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:07.940047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:07.940510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:07.941253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:07.941669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:08.057106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:08.067298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-19ebfb62-fffc-487a-927c-fbcd99b51da1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137941 Oct 28 15:37:08.067852 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 598/1155] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:09.094121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:09.095381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:09.101301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:09.101736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:09.102487 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:09.102906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:09.221121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:09.228788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-057fc306-4f2f-43b1-8780-8a81da5f143c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138253 Oct 28 15:37:09.229341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 558/1156] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:10.245377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:10.245989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:10.252164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:10.252635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:10.253392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:10.253822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:10.370873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:10.378508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b9365c1f-1db9-4cf0-8f72-2b65712e2129 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136810 Oct 28 15:37:10.379060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 599/1157] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:11.399865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:11.400427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:11.407175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:11.407619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:11.408377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:11.408859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:11.525470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:11.533176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6c1babb7-5cd4-4d3c-8b34-8fa0350cd699 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140759 Oct 28 15:37:11.533730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 559/1158] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:12.550213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:12.550837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:12.557049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:12.557484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:12.558226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:12.558642 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:12.676958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:12.684496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cc7c1832-8132-4ef6-9b6a-d16124d94ad1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137923 Oct 28 15:37:12.685052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 600/1159] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:13.701559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:13.702156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:13.708381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:13.708851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:13.709613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:13.710040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:13.831449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:13.839295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c73602ca-10f8-485f-a874-49ed40b08a23 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141343 Oct 28 15:37:13.839844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 560/1160] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:13 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:14.857039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:14.857648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:14.863966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:14.864430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:14.865193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:14.865628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:14.989063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:14.997423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-017978dd-0bf4-46ec-81a5-aed618d1d7e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144602 Oct 28 15:37:14.998012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 601/1161] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:16.014199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:16.014869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:16.020854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:16.021287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:16.022040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:16.022461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:16.142628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:16.150140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3f7e0b99-cd3d-4c49-a706-b6dab9e1e904 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139901 Oct 28 15:37:16.150682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 561/1162] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:17.166992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:17.167599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:17.174365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:17.174800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:17.175551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:17.175975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:17.292536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:17.300739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7999551c-364b-450d-acf0-dcb6ed4de0d6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137359 Oct 28 15:37:17.301294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 602/1163] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:18.318398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:18.318920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:18.325188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:18.325624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:18.326401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:18.326828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:18.442098 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:18.449631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b2f6fa9b-1234-4ffc-b0ec-113671226c32 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135091 Oct 28 15:37:18.450191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 562/1164] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:19.466499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:19.467114 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:19.473288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:19.473727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:19.474481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:19.474912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:19.594534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:19.602170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26f7cde5-ded3-4f6b-a9b4-4d742c083369 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139364 Oct 28 15:37:19.602720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 603/1165] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:20.618760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:20.619347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:20.625995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:20.626439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:20.627193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:20.627625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:20.750399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:20.758268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e7e47524-61bf-4858-a86a-2be565ff7375 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143161 Oct 28 15:37:20.758829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 563/1166] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:20 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:21.775693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:21.776301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:21.783147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:21.783590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:21.784342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:21.784909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:21.901275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:21.909433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a82123d1-456b-4209-a115-972e8561ec81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137402 Oct 28 15:37:21.909985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 604/1167] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:22.926197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:22.926804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:22.933003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:22.933439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:22.934193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:22.935138 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:23.053813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:23.062016 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9fd3477b-c37f-40d1-b498-e822c24b2b6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139569 Oct 28 15:37:23.062609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 564/1168] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:24.078490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:24.079044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:24.085727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:24.086166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:24.086923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:24.087340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:24.225596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:24.233371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-964b5a49-e0df-405b-9541-41dec366d5f8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.158648 Oct 28 15:37:24.233914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 605/1169] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:25.250117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:25.250710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:25.256950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:25.257384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:25.258125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:25.258545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:25.396767 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:25.404878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-14830a67-3e80-4887-b692-bddd541a5476 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.158434 Oct 28 15:37:25.405430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 565/1170] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:26.421882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:26.422560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:26.429089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:26.429517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:26.430275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:26.430698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:26.555328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:26.563788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9d47eb1f-c5e0-45bf-ad12-fa25847467eb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146214 Oct 28 15:37:26.564359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 606/1171] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:26 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:27.581677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:27.582280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:27.588588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:27.589028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:27.589781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:27.590207 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:27.707003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:27.714603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d854e495-c4d6-4ac9-b60f-3d5b90903238 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136683 Oct 28 15:37:27.715159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 566/1172] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:27 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:28.731238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:28.731885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:28.737908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:28.738342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:28.739086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:28.739502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:28.860624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:28.868150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-270df23e-f378-4a0c-b283-dfad7d559f9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140630 Oct 28 15:37:28.868732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 607/1173] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:29.885329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:29.885871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:29.892854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:29.893294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:29.894047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:29.894472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:30.015467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:30.023026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-566d72f1-70fb-480d-bdcc-86f30dc4dddf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141389 Oct 28 15:37:30.023579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 567/1174] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:31.040665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:31.041270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:31.048046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:31.048752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:31.049333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:31.049761 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:31.164637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:31.172883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-68de03e3-0bce-4be1-bd37-4e4081ce7e35 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135926 Oct 28 15:37:31.173447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 608/1175] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:32.189988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:32.190608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:32.196778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:32.197212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:32.197950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:32.198369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:32.333869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:32.342201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-43a85a54-5a51-4c69-8e69-51119e51f732 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.155852 Oct 28 15:37:32.342754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 568/1176] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:33.359263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:33.359807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:33.365957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:33.366389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:33.367135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:33.367558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:33.479231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:37:33.479793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:37:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:37:33.487784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:33.495545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e6623791-854b-45ec-aa05-fe920e4fda68 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140702 Oct 28 15:37:33.496103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 609/1177] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:34.512322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:34.513726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:34.519920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:34.520355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:34.521137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:34.521593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:34.636676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:34.645004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-108ced2a-36ec-4b91-b910-a22744da458d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136333 Oct 28 15:37:34.645561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 569/1178] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:34 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:35.662148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:35.662757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:35.668959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:35.669395 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:35.670190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:35.670610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:35.789096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:35.797197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-931e618b-c54b-43ea-92e5-55257c933d48 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138701 Oct 28 15:37:35.800035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 610/1179] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:36.814736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:36.815343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:36.821613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:36.822053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:36.822814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:36.823243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:36.947539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:36.959094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0e606592-9655-4db5-996b-c42ad2c8435b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148012 Oct 28 15:37:36.959861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 570/1180] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:36 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:37.975614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:37.976214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:37.982715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:37.983141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:37.983900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:37.984321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:38.103165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:38.111576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a5834518-1a4b-43bf-996e-65b865b20d09 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139534 Oct 28 15:37:38.112128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 611/1181] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:39.127892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:39.128530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:39.134342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:39.134778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:39.135527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:39.135950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:39.251716 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:39.259320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3e265d82-eac5-40ae-ba87-660f7894fc0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.134976 Oct 28 15:37:39.259881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 571/1182] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:40.269848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:37:40.270351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:37:40.285046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:40.287045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:40.294423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:40.294877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:40.295628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:40.296079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:40.418577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:40.426188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-13629530-2090-40a4-b1cc-f99efab054a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145067 Oct 28 15:37:40.426776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 612/1183] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:40.642086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:37:40.642484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:37:41.442932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:41.443528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:41.449722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:41.450156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:41.450931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:41.451355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:41.568203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:41.575922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4c70a27e-f9c6-4c7d-9928-6ee84cc16fc0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136640 Oct 28 15:37:41.576497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 572/1184] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:41 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:42.592154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:42.592742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:42.598818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:42.599250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:42.599999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:42.600445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:42.718934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:42.726746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f14a231-8675-46ce-ab98-3e6645956efc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138336 Oct 28 15:37:42.727286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 613/1185] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:42 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:43.743541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:43.744143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:43.750890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:43.751330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:43.752094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:43.752539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:43.871974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:43.879965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ae3adeda-2075-46cf-9cea-6a96eb119d74 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140047 Oct 28 15:37:43.880535 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 573/1186] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:44.897051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:44.897649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:44.904542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:44.904982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:44.905736 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:44.906163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:45.036625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:45.045828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-72cd03d1-ab51-4fe6-8b70-fd660ae5250b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152487 Oct 28 15:37:45.046393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 614/1187] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:44 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:46.062757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:46.063352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:46.069617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:46.070062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:46.070822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:46.071259 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:46.187892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:46.195534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-90d759d2-e9a7-4bb4-97a6-bc3685d132d8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136446 Oct 28 15:37:46.196076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 574/1188] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:47.212254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:47.212903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:47.219765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:47.220208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:47.220995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:47.221418 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:47.344216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:47.352017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8cfd4cba-b02f-44e8-88ea-8321eb0a3efd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143483 Oct 28 15:37:47.352606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 615/1189] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:48.368737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:48.369342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:48.376201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:48.376685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:48.377498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:48.377922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:48.496749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:48.505438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f3df936b-6a2b-46f1-97bf-1b79a78afac6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140308 Oct 28 15:37:48.505990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 575/1190] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:48 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:49.522204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:49.522812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:49.529788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:49.530231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:49.530992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:49.531417 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:49.649456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:49.657205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d69ad69b-90bc-4f2a-8227-3c513da418e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138672 Oct 28 15:37:49.657760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 616/1191] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:49 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:50.681129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:50.681827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:50.688673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:50.689652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:50.690634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:50.691067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:50.815101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:50.829785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fe7cbf2b-9160-42f7-9cf7-0bda40bb89e4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145270 Oct 28 15:37:50.829785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 576/1192] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:51.838660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:51.839263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:51.845372 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:51.845806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:51.846549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:51.846999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:51.965163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:51.973506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-30e9068d-3627-45b3-93dc-7e30fee3ff2c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138444 Oct 28 15:37:51.974060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 617/1193] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:51 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:37:52.990702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:52.991252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:52.997438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:52.997883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:52.998640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:52.999072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:53.115580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:53.123767 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-27586059-ef95-4f20-89b7-4f2569958ccf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136792 Oct 28 15:37:53.124331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 577/1194] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:54.141869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:54.142442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:54.148499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:54.148945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:54.149709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:54.150136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:54.269516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:54.277138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b43c468a-8d46-46bc-a549-033e12ddeb86 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140441 Oct 28 15:37:54.277695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 618/1195] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:55.293789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:55.294367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:55.300520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:55.300952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:55.301695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:55.302115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:55.425140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:55.432917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a73f3f3c-0a81-4b4c-b52b-6ca63b55bf93 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142847 Oct 28 15:37:55.433506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 578/1196] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:55 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:56.454221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:56.455081 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:56.461323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:56.461764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:56.462524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:56.462954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:56.584905 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:56.593181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7624b9cb-3a0b-429d-ac01-c452896737e5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145090 Oct 28 15:37:56.593742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 619/1197] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:57.609984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:57.610594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:57.616790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:57.617231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:57.617989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:57.618416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:57.736469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:57.744914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1dc77925-62e5-4921-9cad-45a6249c836f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139066 Oct 28 15:37:57.745472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 579/1198] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:57 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:58.763700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:58.764301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:58.771397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:58.771836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:58.772628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:58.773058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:58.889692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:37:58.897886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c6548eb4-e445-482e-b2db-049b65ad32b7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138813 Oct 28 15:37:58.898440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 620/1199] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:58 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:37:59.914540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:37:59.915173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:37:59.921393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:59.921837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:37:59.922595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:37:59.923027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:00.041536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:00.049498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c73178a0-773b-4f59-8a80-9246cdccba2e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138593 Oct 28 15:38:00.050061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 580/1200] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:37:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:01.066411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:01.066982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:01.073331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:01.080052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:01.080052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:01.080052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:01.198913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:01.207318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ad1e15d9-2899-4031-97bd-c8195b4a2712 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144760 Oct 28 15:38:01.207868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 621/1201] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:02.223932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:02.224585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:02.230828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:02.231272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:02.232032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:02.232496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:02.350264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:02.357895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b55ad051-4eca-485f-8a2b-1ab987a5e94d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137671 Oct 28 15:38:02.358985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 581/1202] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:02 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:03.375989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:03.376640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:03.382882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:03.383377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:03.384093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:03.384562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:03.505368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:03.513361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f81f18b0-de9a-4462-8612-ffd87395d4cd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142296 Oct 28 15:38:03.513914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 622/1203] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:03 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:04.530794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:04.531324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:04.537469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:04.537910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:04.538669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:04.539094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:04.659065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:04.668253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7877eda5-bf70-435b-b083-f6ce0e0589a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141641 Oct 28 15:38:04.668839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 582/1204] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:04 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:05.685262 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:05.685865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:05.692772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:05.693212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:05.693995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:05.694419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:05.814447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:05.822084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6ca1be28-1ceb-4b9e-adf9-1d26b7b34972 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140502 Oct 28 15:38:05.822636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 623/1205] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:06.839170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:06.839757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:06.846047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:06.846494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:06.847338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:06.847921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:06.964212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:06.971906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2148190a-ea68-4e92-94eb-be0b33423a82 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136623 Oct 28 15:38:06.972410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 583/1206] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:07.988939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:07.989533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:07.995430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:07.995815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:07.996597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:07.997027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:08.115353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:08.122971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f58a0056-def8-4544-b672-bb0a38941424 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137843 Oct 28 15:38:08.123517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 624/1207] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:09.140502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:09.141045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:09.146784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:09.147224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:09.147973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:09.148412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:09.264953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:09.272513 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e3dccf77-3d57-4144-ab7a-d66663ff7722 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136114 Oct 28 15:38:09.273069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 584/1208] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:10.289367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:10.289978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:10.296854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:10.297300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:10.298061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:10.298519 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:10.413895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:10.422008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-01bb5d0d-2c73-41b8-984d-70a2751c59a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136297 Oct 28 15:38:10.422558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 625/1209] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:11.438558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:11.439139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:11.445389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:11.445827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:11.446582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:11.447010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:11.568107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:11.575715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1446b50b-df3c-4b00-a42b-055d20de738e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140816 Oct 28 15:38:11.576266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 585/1210] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:11 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:12.593274 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:12.593851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:12.599999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:12.600455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:12.601200 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:12.601616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:12.719536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:12.727907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9423b37c-5c8d-4667-aa9d-8752ab64eca8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138528 Oct 28 15:38:12.727907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 626/1211] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:13.746087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:13.746724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:13.758202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:13.758202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:13.758202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:13.758202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:13.875497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:13.883066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-af6bfafe-b7a1-47ae-9c5f-65387a5b04bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140719 Oct 28 15:38:13.883623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 586/1212] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:13 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:14.900615 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:14.901536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:14.908516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:14.908992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:14.909725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:14.910156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:15.029799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:15.037844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ef9016d2-457b-4ed3-a558-532435313211 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140821 Oct 28 15:38:15.038399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 627/1213] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:16.043317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:38:16.043917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:38:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:38:16.055420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:16.056143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:16.063826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:16.064268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:16.065068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:16.065494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:16.189153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:16.197013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-88b83985-af0b-44a6-928e-ea7d8d19cbcf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145891 Oct 28 15:38:16.197567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 587/1214] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:17.213683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:17.214287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:17.220672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:17.221112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:17.221858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:17.222282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:17.338409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:17.346755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-25127621-81f2-4ecc-b492-473e67c5faaa tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136724 Oct 28 15:38:17.347307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 628/1215] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:18.362793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:18.363365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:18.369475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:18.369910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:18.370650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:18.371079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:18.498549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:18.506779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-18ac86ad-8a1a-4f79-a899-9548343a2c6d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147557 Oct 28 15:38:18.507371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 588/1216] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:18 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:19.527150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:19.527768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:19.534980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:19.535422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:19.536191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:19.536679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:19.656955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:19.664659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f1f413b-9b16-4ce8-a426-5533ed01e42c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141104 Oct 28 15:38:19.665228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 629/1217] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:20.681240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:20.681850 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:20.688232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:20.688705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:20.689462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:20.689894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:20.806989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:20.814926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-16378dc3-f8e2-40bb-9ffc-8fbce8477f33 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137297 Oct 28 15:38:20.815484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 589/1218] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:20 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:21.830813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:21.831410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:21.837590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:21.838025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:21.838766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:21.839189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:21.959451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:21.967175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bc90763d-041c-4a58-9505-9c43ffb0f69f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140064 Oct 28 15:38:21.967728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 630/1219] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:22.984412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:22.985015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:22.991243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:22.991683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:22.992525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:22.992903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:23.108149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:23.115726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c74e291c-f541-4026-a9e9-3bf11c6ae055 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135067 Oct 28 15:38:23.116280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 590/1220] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:24.132667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:24.133244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:24.139683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:24.140121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:24.140903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:24.141327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:24.260053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:24.267956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-601e4373-def9-42b3-aa39-be3487aecbae tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139086 Oct 28 15:38:24.276011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 631/1221] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:25.285246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:25.286382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:25.292525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:25.292969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:25.293731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:25.294673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:25.421487 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:25.429113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a2b8ea50-918a-4522-886e-a127c2fb64f3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148108 Oct 28 15:38:25.429664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 591/1222] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:26.445603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:26.446206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:26.452419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:26.452856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:26.453603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:26.454028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:26.782548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:26.790889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-50677f00-2f31-4eab-a288-4705d666c5f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.348891 Oct 28 15:38:26.791504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 632/1223] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:26 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:27.808226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:27.808840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:27.815047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:27.815482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:27.816228 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:27.816722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:27.932734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:27.940686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-82549f3d-bd27-44e0-adb8-bbc73bf39189 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136070 Oct 28 15:38:27.941254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 592/1224] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:27 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:28.957909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:28.959582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:28.968685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:28.969124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:28.969894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:28.970348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:29.090657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:29.098184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f1bdd46b-bb26-4833-9221-2b87a514ea4a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144678 Oct 28 15:38:29.098737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 633/1225] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:30.114629 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:30.115178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:30.121410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:30.124468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:30.124468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:30.124468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:30.238719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:30.246646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a65f3b40-af37-4516-8930-a0320938f184 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135794 Oct 28 15:38:30.247230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 593/1226] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:31.264197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:31.264769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:31.270953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:31.271397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:31.272153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:31.272619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:31.392001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:31.399976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9bd40c73-8438-4465-ad72-b2bd73a438ba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139778 Oct 28 15:38:31.400565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 634/1227] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:32.416634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:32.417266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:32.423332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:32.426134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:32.426134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:32.426134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:32.551051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:32.558904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-72db5084-bd6e-43c3-86eb-dcec1dc1a3e2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145943 Oct 28 15:38:32.559461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 594/1228] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:33.575751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:33.576488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:33.582840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:33.583276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:33.584038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:33.584499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:33.706331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:33.715007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6834af67-ff9b-4d72-9c19-94976d48454e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143113 Oct 28 15:38:33.715586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 635/1229] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:33 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:34.732239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:34.732860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:34.739428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:34.739924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:34.741875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:34.741875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:34.863047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:34.870680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c1a884a9-8374-49e9-b1f3-93f73e525787 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142128 Oct 28 15:38:34.871236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 595/1230] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:34 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:35.888144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:35.888782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:35.895443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:35.895889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:35.896712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:35.897138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:36.017706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:36.025978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-856bf5fe-6e3a-4330-b1fe-9d91e9edc212 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141844 Oct 28 15:38:36.026534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 636/1231] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:37.042213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:37.042753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:37.049443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:37.050888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:37.050888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:37.051747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:37.177157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:37.184710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-71697de7-ec96-4636-98ad-1bc1967bad58 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146260 Oct 28 15:38:37.185267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 596/1232] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:38.201824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:38.202418 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:38.208883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:38.209325 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:38.210083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:38.210510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:38.329475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:38.336283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f667b875-b176-4d78-8fde-0ab7af06bde1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138103 Oct 28 15:38:38.336876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 637/1233] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:38 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:39.353116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:39.353663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:39.359467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:39.359909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:39.360684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:39.361115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:39.479104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:39.487113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-534b362e-2114-4483-8181-01e6f00eea51 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137325 Oct 28 15:38:39.487659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 597/1234] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:40.503587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:40.504192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:40.510408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:40.510846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:40.511870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:40.512299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:40.627850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:40.635600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b49e84e2-8639-4ff8-af0f-41f58477a116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.135719 Oct 28 15:38:40.636162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 638/1235] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:41.652075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:41.652721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:41.659335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:41.659772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:41.660557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:41.660983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:41.781144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:41.789075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9a6f34ed-f2c9-4cda-bc58-ed0f32c9b2bc tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140667 Oct 28 15:38:41.789625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 598/1236] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:41 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:42.806457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:42.807065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:42.813291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:42.813901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:42.814660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:42.815088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:42.935820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:42.943720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a2c97831-1d60-4d82-aaa8-37624a4851d0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140954 Oct 28 15:38:42.944282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 639/1237] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:42 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:43.960710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:43.961317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:43.967447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:43.967888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:43.968714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:43.969149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:44.086166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:44.093745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5f8f8699-dee9-48b4-a8e6-450b6d9074e1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136697 Oct 28 15:38:44.094294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 599/1238] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:45.111042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:45.111671 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:45.121923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:45.122368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:45.123134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:45.123563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:45.273006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:45.280910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-81f4e6cf-013b-4c7c-8c0c-9c3f9296ee72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.173603 Oct 28 15:38:45.281475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 640/1239] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:45 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:46.299123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:46.299728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:46.305857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:46.306252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:46.307010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:46.307502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:46.429738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:46.437331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c7dffd8e-c2fc-462c-ac16-0fe1960660fd tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142400 Oct 28 15:38:46.437882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 600/1240] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:47.454536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:47.455694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:47.461937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:47.462387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:47.463140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:47.463571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:47.582186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:47.589865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2a1dff42-66c8-4a4f-97ce-bd4774c41b06 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139089 Oct 28 15:38:47.590416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 641/1241] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:48.606473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:48.607067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:48.613431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:48.613885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:48.614640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:48.615100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:48.731902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:48.739546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-deb5dcce-42a0-4b4e-92a9-c7b512c919a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136675 Oct 28 15:38:48.740106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 601/1242] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:48 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:49.756224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:49.756859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:49.763337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:49.763780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:49.764577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:49.765013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:49.884600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:49.893065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d289e5aa-0464-4a4f-b884-e9693e326fa1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140604 Oct 28 15:38:49.893624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 642/1243] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:49 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:38:50.920078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:50.920734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:50.927078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:50.927516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:50.928280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:50.928733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:51.196221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:51.203834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f4cf3e6e-dfbf-43c1-bf3a-4af896da4cf1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.287422 Oct 28 15:38:51.204982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 602/1244] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:52.221794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:52.222406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:52.228683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:52.229127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:52.229884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:52.230313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:52.347508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:52.355166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e5e3e648-d475-4388-83ae-09dbc725d8c3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137630 Oct 28 15:38:52.355725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 643/1245] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:38:53.371960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:53.372571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:53.378768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:53.379215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:53.379975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:53.380421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:53.499608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:53.507343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-58d24b44-1bdc-4b18-aabc-78f5616196e6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139183 Oct 28 15:38:53.507889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 603/1246] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:53 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:54.524821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:54.525434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:54.531205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:54.531643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:54.532487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:54.532914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:54.651832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:54.659523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f4ed8844-d3f1-4de5-a5aa-4a010dc6b1a8 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138912 Oct 28 15:38:54.660079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 644/1247] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:55.676131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:55.676762 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:55.682950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:55.683386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:55.684131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:55.684578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:55.809000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:55.816870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-993db05c-e6f3-4918-b2cc-f8ef2ff072a0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144360 Oct 28 15:38:55.817405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 604/1248] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:55 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:56.833050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:56.833542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:56.839687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:56.840128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:56.840912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:56.841332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:56.962364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:56.969954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2456d715-97c0-449f-a71d-25e7dfcd21b0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141222 Oct 28 15:38:56.978154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 645/1249] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:58.179235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:58.179847 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:58.185490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:58.185933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:58.186691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:58.187119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:58.303108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:58.310701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-95065f2e-4efd-46c5-9e27-59e5ab05139a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.328010 Oct 28 15:38:58.311243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 605/1250] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:57 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:38:59.327451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:38:59.327985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:38:59.337762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:59.338209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:59.338973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:38:59.339403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:38:59.456958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:38:59.464518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9718ab2b-04c7-48e7-9bef-5a8256b6e81f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140765 Oct 28 15:38:59.465079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 646/1251] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:38:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:00.481733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:00.482373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:00.488634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:00.489082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:00.489841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:00.490272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:00.610898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:00.618475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-42d251af-630d-4907-a888-7a683de1f2b6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140407 Oct 28 15:39:00.619022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 606/1252] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:00 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:01.634867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:01.635470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:01.642592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:01.642932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:01.643683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:01.647256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:01.764350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:01.772649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5b552dff-51aa-42e5-b829-96c8bb057120 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141461 Oct 28 15:39:01.773211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 647/1253] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:02.789242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:02.789857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:02.796215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:02.796683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:02.797440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:02.797864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:02.914611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:02.922714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d58d5115-825d-4a42-a393-eebeafcab1ef tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136676 Oct 28 15:39:02.923258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 607/1254] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:02 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:03.939136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:03.939731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:03.945845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:03.946277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:03.947024 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:03.947438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:04.068169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:04.080530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3c47d1cb-1864-48b1-a410-c0e59f0fe25b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145490 Oct 28 15:39:04.081104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 648/1255] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:03 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:05.097366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:05.097967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:05.104179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:05.104649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:05.105411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:05.105838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:05.229532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:05.237085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aed8a990-34be-4762-b579-7333547c9698 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143393 Oct 28 15:39:05.237636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 608/1256] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:06.254896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:06.256180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:06.262691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:06.263133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:06.263929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:06.264354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:06.383736 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:06.391585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-57cf8936-b730-4ec2-a815-6de7abe2ba72 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141673 Oct 28 15:39:06.392131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 649/1257] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:07.408509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:07.409149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:07.415527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:07.421991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:07.421991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:07.421991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:07.589438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:07.597151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-84e56a25-7881-4a8e-8dcc-fb2ccf49a033 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.192882 Oct 28 15:39:07.597702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 609/1258] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:07 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:08.613893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:08.614451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:08.620306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:08.620822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:08.621590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:08.622016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:08.787504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:08.795237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d637a541-a07a-466c-8ddf-6f6fff553fe6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.185228 Oct 28 15:39:08.795791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 650/1259] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:08 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:09.811957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:09.812706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:09.823127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:09.823567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:09.824782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:09.825298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:09.943547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:09.951156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-72a3b740-c1bb-47ed-95f3-99074568ec6f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142971 Oct 28 15:39:09.951710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 610/1260] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:09 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:10.967091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:10.967709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:10.974405 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:10.974842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:10.975593 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:10.976028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:11.097252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:11.104877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c2bfc1e5-8ae3-48ea-9eb2-e846ba4eebf5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141479 Oct 28 15:39:11.105435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 651/1261] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:10 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:12.121498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:12.122043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:12.128234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:12.128703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:12.129463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:12.129890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:12.261224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:12.268826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-795779a3-399c-4301-b136-bfa562aaeea0 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.151000 Oct 28 15:39:12.269376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 611/1262] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:12 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:13.285662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:13.286220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:13.292331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:13.292804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:13.293557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:13.293981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:13.425462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:13.433022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26189e2b-bb56-403b-bcfa-ca959c1c352e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.151216 Oct 28 15:39:13.433595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 652/1263] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:13 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:14.450760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:14.451360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:14.457637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:14.458082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:14.458845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:14.459275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:14.579648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:14.587682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a9aafed6-a474-45d9-be68-368616c48b53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140586 Oct 28 15:39:14.588232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 612/1264] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:14 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:15.605065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:15.605665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:15.611762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:15.612207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:15.613003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:15.613430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:15.734539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:15.743020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62f6dfb5-6c66-4996-b15d-6b726ad49bc5 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141467 Oct 28 15:39:15.743679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 653/1265] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:15 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:16.759922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:16.760645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:16.767474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:16.767920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:16.768726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:16.769155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:16.892815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:16.900479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e0af77d8-07be-4b88-84da-96cd15192ea3 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144145 Oct 28 15:39:16.901028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 613/1266] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:16 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:17.917695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:17.918318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:17.924466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:17.924910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:17.925658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:17.926085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:18.045158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:18.052926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-82bf544d-2c6c-4ebd-b26e-79f9af127239 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138780 Oct 28 15:39:18.053423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 654/1267] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:17 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:19.069933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:19.070569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:19.076887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:19.077332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:19.078756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:19.079192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:19.197912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:19.206147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a048e497-3ec5-419a-9d86-f472a751a256 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139864 Oct 28 15:39:19.206689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 614/1268] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:19 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:39:20.223480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:20.224070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:20.230347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:20.230786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:20.231539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:20.231961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:20.349905 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:20.357444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eab4c856-df0f-4bd9-93cc-474dcfeb49d4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137648 Oct 28 15:39:20.357995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 655/1269] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:20 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:21.374696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:21.375231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:21.381423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:21.381867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:21.382631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:21.383065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:21.503927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:21.511819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1a0f799c-2757-43cd-ad1f-4ef094f5551e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140920 Oct 28 15:39:21.512362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 615/1270] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:21 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:22.528797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:22.529395 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:22.536558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:22.536994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:22.537738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:22.538203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:22.656546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:22.664296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0cd67c5c-f94a-40e6-84b3-40aff74e2687 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139506 Oct 28 15:39:22.664889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 656/1271] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:22 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:23.681556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:23.682171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:23.689061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:23.689508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:23.690271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:23.690702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:23.814793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:23.817965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9977c054-0c0e-4cf0-a7c6-32ff3fde182b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140031 Oct 28 15:39:23.818533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 616/1272] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:23 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:24.834950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:24.835554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:24.841747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:24.842184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:24.843469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:24.843916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:24.975879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:24.984219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-48111f60-8319-4088-888a-8b88e476e5d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.152326 Oct 28 15:39:24.984803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 657/1273] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:24 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:26.001104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:26.001644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:26.007758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:26.008205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:26.009081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:26.009512 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:26.127216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:26.135001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4ee96a68-afd6-4389-a29a-65cced60ee0b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137688 Oct 28 15:39:26.135548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 617/1274] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:25 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:27.152551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:27.153164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:27.159856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:27.160294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:27.161078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:27.161504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:27.282275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:27.289871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f3ba086b-a68d-4dcf-8a57-b770dfe34099 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141041 Oct 28 15:39:27.290419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 658/1275] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:27 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:28.306174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:28.306787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:28.313811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:28.314262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:28.315034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:28.315469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:28.442828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:28.450434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a648da9e-0ceb-47be-8ca6-24908b7ce145 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147817 Oct 28 15:39:28.450990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 618/1276] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:28 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:29.468182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:29.468849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:29.475233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:29.475680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:29.476463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:29.477105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:29.603508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:29.612813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2915dc8d-88ce-4962-a91c-1a5a8357cdb4 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147647 Oct 28 15:39:29.612813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 659/1277] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:29 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:30.628465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:30.629214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:30.635991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:30.636453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:30.637380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:30.637815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:30.757783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:30.766743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1e42ab61-cccb-4a94-9fcf-dea5027ada0c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141870 Oct 28 15:39:30.767285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 619/1278] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:30 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:31.782869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:31.783474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:31.789651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:31.790090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:31.790842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:31.791263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:31.913053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:31.921261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-59b3a001-0aac-4b09-bbb3-d629dcf87ec6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141589 Oct 28 15:39:31.921818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 660/1279] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:31 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:32.938611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:32.939385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:32.945515 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:32.945962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:32.946721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:32.947148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:33.064480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:33.072408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8b31587f-3aa1-45a9-9071-44ec552743a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138001 Oct 28 15:39:33.072960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 620/1280] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:32 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:34.089847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:34.090401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:34.096676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:34.097122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:34.097891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:34.098321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:34.215086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:34.222743 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cd54b2ed-0f39-4636-8cd7-b24e047b25a6 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136756 Oct 28 15:39:34.223304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 661/1281] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:34 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:35.239489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:35.240085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:35.246230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:35.246670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:35.247416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:35.247840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:35.369627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:35.377734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0beb8911-79a1-4b47-91eb-6bd0e7f7a879 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141851 Oct 28 15:39:35.378271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 621/1282] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:35 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:36.395245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:36.395844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:36.402045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:36.402476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:36.403223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:36.403638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:36.522222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:36.530377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-91b31711-77e8-47af-bfaf-5867fac0d9f2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138173 Oct 28 15:39:36.530975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 662/1283] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:36 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:37.547148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:37.547784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:37.554049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:37.554494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:37.555257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:37.555688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:37.673131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:37.681058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7318672a-05d5-4087-9549-826749f0f8db tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138269 Oct 28 15:39:37.681777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 622/1284] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:37 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:38.697910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:38.698504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:38.704798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:38.705232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:38.705971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:38.706388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:38.828955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:38.836856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-991a5893-1f54-4295-a461-e3afbef818bf tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142677 Oct 28 15:39:38.837410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 663/1285] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:38 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:39.854270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:39.854904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:39.861195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:39.861637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:39.862391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:39.862819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:39.992625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:39.992625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8687ee6a-d7e0-4b94-a8ec-b58914d987a1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136682 Oct 28 15:39:39.992625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 623/1286] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:39 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:41.003896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:41.004467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:41.010800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:41.011246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:41.012027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:41.012471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:41.131632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:41.140274 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-08dc2cdc-20c7-4583-b2b1-07776420ccf7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.140076 Oct 28 15:39:41.140856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 664/1287] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:40 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:42.157288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:42.157888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:42.163929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:42.164365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:42.165364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:42.165615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:42.285519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:42.293081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dad4036f-53f9-41b5-8a03-f256f71cbb78 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.139449 Oct 28 15:39:42.293621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 624/1288] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:42 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:43.310244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:43.310788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:43.317245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:43.317689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:43.318458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:43.318887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:43.445533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:43.453878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-62a1232e-aeea-4bbc-bccf-50907df16d6e tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.147414 Oct 28 15:39:43.454439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 665/1289] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:43 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:44.471052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:44.471583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:44.477790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:44.478235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:44.478998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:44.479430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:44.597238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:44.605042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-00b03a19-04c5-48e8-8ee1-74276265e764 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.138267 Oct 28 15:39:44.605593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 625/1290] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:44 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:45.621673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:45.622240 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:45.628968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:45.629402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:45.630178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:45.630600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:45.755592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:45.763829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e2d4ef82-b0d8-4feb-8c35-b9c8b94d274a tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.145925 Oct 28 15:39:45.764400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 666/1291] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:45 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:46.780750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:46.781377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:46.791719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:46.792194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:46.792988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:46.793417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:46.914710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:46.925620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2d1a6edb-ac0d-4d95-b963-b13cd47769ab tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146576 Oct 28 15:39:46.926185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 626/1292] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:46 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:47.942668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:47.943295 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:47.949511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:47.949948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:47.951322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:47.951740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:48.074931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:48.083142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37684370-094c-456e-8e3f-e40b7fcbe428 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.144158 Oct 28 15:39:48.089515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 667/1293] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:47 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:49.098918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:49.099523 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:49.105902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:49.106354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:49.107132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:49.107563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:49.228759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:49.236325 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fd7bf5de-76d7-4224-9c3c-9d423c318d9f tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141175 Oct 28 15:39:49.236903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 627/1294] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:49 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:50.253416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:50.254032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:50.260493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:50.260941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:50.261703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:50.262129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:50.378154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:50.386051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dea05e7d-d272-412a-9691-28068e285edb tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136346 Oct 28 15:39:50.386608 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 668/1295] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:50 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:51.403110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:51.404291 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:51.410501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:51.410940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:51.411694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:51.412144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:51.532831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:51.541940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dbe66657-e9c0-474b-95a1-9248688a1385 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142468 Oct 28 15:39:51.543853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 628/1296] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:51 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:52.558619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:52.559247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:52.565588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:52.566037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:52.566801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:52.567231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:52.693294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:52.701148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-21099491-163a-4c72-9f42-cc86f1145b81 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.146281 Oct 28 15:39:52.701711 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 669/1297] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:52 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:53.717753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:53.718362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:53.724662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:53.725108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:53.725873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:53.726300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:53.843063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:53.850857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0c8632f1-ec1b-4b2a-9843-bda01f860c07 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137365 Oct 28 15:39:53.851416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 629/1298] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:53 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:54.868094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:54.868710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:54.874865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:54.875305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:54.876056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:54.876506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:54.993376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:55.001145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d4707e4d-50df-4fba-9a87-cef8e8848100 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.136767 Oct 28 15:39:55.002435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 670/1299] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:54 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:56.018136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:56.018685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:56.029301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:56.030255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:56.031331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:56.031768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:56.154007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:56.162352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-01d6753e-f9b7-4862-be21-5b349931e162 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.148486 Oct 28 15:39:56.162906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 630/1300] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:56 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:57.179600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:57.180181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:57.186860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:57.187290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:57.188033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:57.188483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:57.304600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:57.312881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f24052fc-42c7-4911-8a14-ed800e257f75 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137041 Oct 28 15:39:57.313432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 671/1301] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:57 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:58.329621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:58.330221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:58.336482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:58.336929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:58.337690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:58.338117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:58.454446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:58.463309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1b67fd19-3b44-4ab0-bb79-1f9cb9bd6794 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137340 Oct 28 15:39:58.463851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 631/1302] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:58 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:39:59.485308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:39:59.485987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:39:59.492061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:59.492541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:59.493293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:39:59.493716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:39:59.614744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:39:59.623012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ab1996fb-6446-4d3f-81c4-9481c80995ac tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141470 Oct 28 15:39:59.623676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 672/1303] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:39:59 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:00.640490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:00.641096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:00.647270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:00.647717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:00.648499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:00.648933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:00.770268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:00.778380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-923e4de3-92ca-4855-910a-dcd78e1aa116 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.141147 Oct 28 15:40:00.779158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 632/1304] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:00 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:01.795347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:01.795947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:01.802137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:01.802578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:01.803331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:01.803791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:01.921038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:01.928610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ae78a586-57f2-47f0-9ec8-d22af168ebd7 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.137447 Oct 28 15:40:01.929164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 673/1305] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:01 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:02.945250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:02.945975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:02.952226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:02.952708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:02.953477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:02.953913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:03.082722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:03.091069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5dd1935a-e9c4-4d51-9419-ece2a70431d2 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.149012 Oct 28 15:40:03.091902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 633/1306] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:02 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:04.107060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:04.107899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:04.117635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:04.126931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:04.126931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:04.126931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:04.238579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:04.246232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5db3755e-31b5-4bbc-b8fe-6f1b1675032b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.142900 Oct 28 15:40:04.246797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 674/1307] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:04 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:05.262760 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:05.263388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:05.269440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:05.269979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:05.270682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:05.271009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:05.394652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:05.403058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0253028b-c34b-432b-8e0b-d37747e86131 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.143584 Oct 28 15:40:05.403617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 634/1308] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:05 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:06.424216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:40:06.427812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:40:06.431038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:06.431475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:06.432227 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:40:06.432677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:40:06.572898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:40:06.590876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3c307d52-e68c-4405-bae9-55e50001b847 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86" status: 200 len: 1559 microversion: 2.1 time: 0.162413 Oct 28 15:40:06.590876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 675/1309] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:40:06 2021] GET /compute/v2.1/servers/07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:40:53.498505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:40:53.499113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:40:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:41:00.295710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:41:00.296296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:41:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:41:00.660312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:41:00.660779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:41:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:41:10.095216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:41:10.095911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:41:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:41:23.350730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:41:23.351287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:41:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:41:36.061249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:41:36.061913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:41:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:42:02.547662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:42:02.548219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:42:02.555241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:42:02.555778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:42:02.556649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:42:02.557159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:42:02.571454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. Oct 28 15:42:02.572064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:42:02.572903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e8a4c5d0-054e-475b-a739-7cefa5d9a1ef tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 404 len: 111 microversion: 2.1 time: 0.029896 Oct 28 15:42:02.573430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 635/1310] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:42:02 2021] DELETE /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:42:02.582001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:42:02.582782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: e2b1113c-fcf2-4a62-962c-98c13d3fbb28] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:42:02.588533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:42:02.588980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:42:02.589821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:42:02.590253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:42:02.605612 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. Oct 28 15:42:02.606205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance e2b1113c-fcf2-4a62-962c-98c13d3fbb28 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:42:02.607033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fc2da7f9-62f8-4ff7-9a20-8167a5d69776 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28" status: 404 len: 111 microversion: 2.1 time: 0.029667 Oct 28 15:42:02.610498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 676/1311] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:42:02 2021] GET /compute/v2.1/servers/e2b1113c-fcf2-4a62-962c-98c13d3fbb28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:42:58.677757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 15:42:58.792591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-1ef70142-299f-45b7-bbc6-ce005b6ff53b req-793f8176-5000-490f-9a51-0a7b8d08623b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f8d0b6-a6f5-4768-8039-c0e7cd03aa86", "name": "network-vif-deleted", "tag": "14ee62a7-daaf-4e0d-93c6-8df9ecaae09d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:42:58.794240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:42:58.794240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:42:58.801514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1ef70142-299f-45b7-bbc6-ce005b6ff53b req-793f8176-5000-490f-9a51-0a7b8d08623b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:42:58.801941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1ef70142-299f-45b7-bbc6-ce005b6ff53b req-793f8176-5000-490f-9a51-0a7b8d08623b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:42:58.812524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-1ef70142-299f-45b7-bbc6-ce005b6ff53b req-793f8176-5000-490f-9a51-0a7b8d08623b service nova] Creating event network-vif-deleted:14ee62a7-daaf-4e0d-93c6-8df9ecaae09d for instance 07f8d0b6-a6f5-4768-8039-c0e7cd03aa86 on hv-cinder-78364 Oct 28 15:42:58.818270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-1ef70142-299f-45b7-bbc6-ce005b6ff53b req-793f8176-5000-490f-9a51-0a7b8d08623b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146308 Oct 28 15:42:58.818822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 636/1312] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:44:13.515927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:44:13.516558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:44:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:44:20.313093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:44:20.314358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:44:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:44:20.679894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:44:20.680307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:44:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:44:43.368078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:44:43.368683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:44:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:44:56.077410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:44:56.078065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:44:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:45:29.825966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 15:45:29.829535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:29.835266 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:29.837197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:29.837646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:29.838402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:29.838834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:29.865617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:45:30.109366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5d7f6d4d-bbc0-4f3b-b665-e57789cd6d37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 204 len: 0 microversion: 2.1 time: 0.284741 Oct 28 15:45:30.110188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 677/1313] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:45:29 2021] DELETE /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:45:30.132312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52532. Oct 28 15:45:30.137709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:30.138418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:30.146140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:30.146588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:30.147356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:30.147789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:30.347891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:30.355081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a247b045-54b1-4f6e-bc6f-65433766324f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1506 microversion: 2.1 time: 0.240944 Oct 28 15:45:30.355625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 637/1314] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:30 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:31.372670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:31.373386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:31.395984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52546. Oct 28 15:45:31.398770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:31.399210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:31.399986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:31.400435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:31.578680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:31.586320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0c2a8058-6f0c-4aa2-8ef5-0b036a95e8ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1506 microversion: 2.1 time: 0.217830 Oct 28 15:45:31.586896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 678/1315] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:31 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:31.830193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59063a8-b8d4-40b6-97e8-cbe60c3df84a", "name": "network-vif-deleted", "tag": "d916c38b-451d-479f-a682-24e2eb78f02d"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:45:31.831903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:45:31.831903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:45:31.839340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:31.839785 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:31.851276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] Creating event network-vif-deleted:d916c38b-451d-479f-a682-24e2eb78f02d for instance e59063a8-b8d4-40b6-97e8-cbe60c3df84a on hv-cinder-78364 Oct 28 15:45:31.854826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] [575e18ac-21d5-4dba-9ece-54d0407e7429] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 15:45:32.602752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:32.603354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:32.609722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:32.610167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:32.610923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:32.611349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:32.641413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:32.641853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:32.642290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lazy-loading 'fault' on Instance uuid e59063a8-b8d4-40b6-97e8-cbe60c3df84a {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:45:32.686825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:32.695035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60079560-0880-43a2-a557-6fbe8ea9b133 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 200 len: 1311 microversion: 2.1 time: 0.095897 Oct 28 15:45:32.695606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 679/1316] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:32 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:45:32.871029 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] [575e18ac-21d5-4dba-9ece-54d0407e7429] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52562. Oct 28 15:45:33.020841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-a1630c7c-d050-4d89-94bb-b99e640179f4 req-043fa817-e5dd-4585-9afb-f37442d92659 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049597 Oct 28 15:45:33.020841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 638/1317] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:45:33.712344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:33.712959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: e59063a8-b8d4-40b6-97e8-cbe60c3df84a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:33.719145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:33.719588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:33.720360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:33.720804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:33.734117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] HTTP exception thrown: Instance e59063a8-b8d4-40b6-97e8-cbe60c3df84a could not be found. Oct 28 15:45:33.734694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Returning 404 to user: Instance e59063a8-b8d4-40b6-97e8-cbe60c3df84a could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:45:33.735495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-092144db-f1e9-4084-8cb5-930232ede4a2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a" status: 404 len: 111 microversion: 2.1 time: 0.026934 Oct 28 15:45:33.736002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 680/1318] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:33 2021] GET /compute/v2.1/servers/e59063a8-b8d4-40b6-97e8-cbe60c3df84a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:45:33.744154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:33.744765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:33.750788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:33.751234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:33.752001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:33.752450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:33.776587 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:45:33.994125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d282e700-7955-45bb-9892-64916a965248 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 204 len: 0 microversion: 2.1 time: 0.253560 Oct 28 15:45:33.994805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 639/1319] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:45:33 2021] DELETE /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:45:34.002865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:34.003827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:34.009548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:34.010019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:34.010772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:34.011198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:34.139062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:34.147388 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d36beda7-8b87-43a8-8731-2d03b57b4603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.148742 Oct 28 15:45:34.147941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 681/1320] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:35.165138 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:35.165836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:35.172226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:35.172700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:35.173471 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:35.173904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:35.292495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:35.301321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-55d92fad-b63f-479c-a74d-9c26e1c1f41f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1566 microversion: 2.1 time: 0.140150 Oct 28 15:45:35.301876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 640/1321] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1566 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:35.532775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-87340701-06ca-40d9-807c-fca0a8f6f499 req-598f6e87-edd3-46a6-945e-ab820dbb8bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13279aaf-dc79-4544-b2dc-8c5099d7b405", "name": "network-vif-deleted", "tag": "fac61c7a-48c7-42f0-b93d-6b3cb97a91c9"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:45:35.534836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:45:35.534836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:45:35.541832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-87340701-06ca-40d9-807c-fca0a8f6f499 req-598f6e87-edd3-46a6-945e-ab820dbb8bb5 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:35.542263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-87340701-06ca-40d9-807c-fca0a8f6f499 req-598f6e87-edd3-46a6-945e-ab820dbb8bb5 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:35.555541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-87340701-06ca-40d9-807c-fca0a8f6f499 req-598f6e87-edd3-46a6-945e-ab820dbb8bb5 service nova] Creating event network-vif-deleted:fac61c7a-48c7-42f0-b93d-6b3cb97a91c9 for instance 13279aaf-dc79-4544-b2dc-8c5099d7b405 on hv-cinder-78364 Oct 28 15:45:35.560657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-87340701-06ca-40d9-807c-fca0a8f6f499 req-598f6e87-edd3-46a6-945e-ab820dbb8bb5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 Oct 28 15:45:35.561216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 682/1322] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:45:36.317767 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:36.318365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:36.324481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:36.324917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:36.325673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:36.326105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:36.389747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:36.398298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-58b9788c-2d3e-4668-9750-ce062d36b2c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085165 Oct 28 15:45:36.398848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 641/1323] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:37.415955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:37.416682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:37.422645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:37.430202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:37.430202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:37.430202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:37.486816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:37.494484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8f2dc7a8-84c9-4fe3-8d6e-96ef7ea7df14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083199 Oct 28 15:45:37.495035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 683/1324] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:38.511568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:38.512208 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:38.518602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:38.519047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:38.519816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:38.520243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:38.579559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:38.587187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e1685bb2-401c-4b0b-b81b-ec13462f2cad tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079280 Oct 28 15:45:38.587727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 642/1325] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:39.604142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:39.604786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:39.611010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:39.611961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:39.612745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:39.613176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:39.670540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:39.678745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-95ed3374-ec22-44ad-9ca7-73c067ba5d6b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078294 Oct 28 15:45:39.679290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 684/1326] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:40.700149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:40.700768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:40.707522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:40.707966 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:40.708763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:40.709196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:40.769432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:40.777066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-164bad64-ccbe-4d3d-8a64-d7fbaf279de7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080550 Oct 28 15:45:40.777623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 643/1327] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:41.793399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:41.794004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:41.800187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:41.800659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:41.801416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:41.801849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:41.860000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:41.867872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-42970169-66b6-4764-8516-ecf00aff1c90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078153 Oct 28 15:45:41.868435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 685/1328] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:42.884517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:42.885125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:42.891391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:42.891836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:42.892631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:42.893061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:42.950417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:42.958027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-635d65da-4e2b-44a9-beb8-d105d3e60ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077266 Oct 28 15:45:42.958574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 644/1329] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:43.975171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:43.975802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:43.981976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:43.982414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:43.983166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:43.983592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:44.045878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:44.053685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3f08261a-0d0d-484d-9776-d2a8405785dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082130 Oct 28 15:45:44.054242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 686/1330] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:45.070446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:45.071006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:45.077087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:45.077532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:45.078275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:45.078699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:45.136693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:45.144889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dedbf72a-81cf-47c0-b88b-08fca57796fd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078048 Oct 28 15:45:45.145429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 645/1331] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:46.161758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:46.162302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:46.168675 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:46.169148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:46.169911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:46.170338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:46.229451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:46.237025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e89cd6ba-03c2-42ce-9b4c-d59440c2fca2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079570 Oct 28 15:45:46.237565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 687/1332] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:47.253409 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:47.254010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:47.260203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:47.260680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:47.261435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:47.261861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:47.319743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:47.327547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bf9329a0-8b5f-4dee-b5ca-e1c543b499e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078456 Oct 28 15:45:47.328093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 646/1333] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:48.343923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:48.344558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:48.350713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:48.351146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:48.351891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:48.352312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:48.412053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:48.420172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4d6cc459-e342-48d3-b104-76451b70acc3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079769 Oct 28 15:45:48.420706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 688/1334] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:49.440195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:49.440822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:49.447165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:49.447606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:49.448458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:49.448819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:49.507143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:49.514662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9fa5620a-0249-4551-ba21-6f1e37c24781 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078756 Oct 28 15:45:49.515204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 647/1335] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:50.531083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:50.531679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:50.537910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:50.538348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:50.539109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:50.539535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:50.600210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:50.607909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ca25b8be-4055-4d1a-9599-24357458fefc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080546 Oct 28 15:45:50.608478 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 689/1336] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:51.624160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:51.624788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:51.631168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:51.631600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:51.632351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:51.632798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:51.691871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:51.699406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-302fcba0-e858-4a8d-998d-e0dffde778a5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078898 Oct 28 15:45:51.699951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 648/1337] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:52.716118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:52.716734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:52.723384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:52.723825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:52.724613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:52.725040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:52.785956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:52.793693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-beb5f248-6b7b-4a6b-b808-231da5468ca0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081209 Oct 28 15:45:52.794246 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 690/1338] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:53.810710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:53.811313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:53.818135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:53.818578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:53.819338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:53.819768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:53.878256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:53.886124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-80aa7841-ba5b-4b6f-b94a-34d2622b1f49 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079081 Oct 28 15:45:53.886690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 649/1339] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:54.901851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:54.902456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:54.909193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:54.909636 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:54.910392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:54.910821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:54.968112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:54.976191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c9b0056-e463-4cb3-8a83-e13c956f18ec tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078078 Oct 28 15:45:54.976775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 691/1340] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:55.993340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:55.993896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:56.000021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:56.000491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:56.001916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:56.002342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:56.059848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:56.068286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-de4a929a-39fa-4a3f-99a5-5ce7900a1659 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078676 Oct 28 15:45:56.068892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 650/1341] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:57.084023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:57.084629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:57.090826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:57.091263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:57.092017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:57.092467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:57.153464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:57.161537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-63d756ff-22e1-4237-b470-048caedac145 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081292 Oct 28 15:45:57.162085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 692/1342] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:58.178418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:58.179020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:58.185217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:58.185658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:58.186412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:58.186839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:58.244180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:58.252362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f335f79a-682c-4336-aaaa-65f1279bd2ca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077619 Oct 28 15:45:58.253199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 651/1343] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:45:59.268932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:45:59.269544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:45:59.275829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:59.276269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:59.277073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:45:59.277505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:45:59.335535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:45:59.343203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-00dfe64c-66f3-4dde-8484-943295bdd60d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078013 Oct 28 15:45:59.343751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 693/1344] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:45:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:00.361173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:00.361770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:00.368600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:00.369051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:00.369828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:00.370263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:00.428877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:00.436457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bc083825-7275-4cca-bb55-4b27e306fe6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079932 Oct 28 15:46:00.437009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 652/1345] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:01.452560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:01.453110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:01.458849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:01.459287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:01.460039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:01.460492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:01.518320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:01.525859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a98cae9b-78ec-46ca-a632-b302a6c8106e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077256 Oct 28 15:46:01.526414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 694/1346] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:02.542596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:02.543201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:02.549287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:02.552606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:02.552606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:02.552606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:02.609286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:02.617548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d5982f39-09c8-423a-ad5e-7f3e23cb5e39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078623 Oct 28 15:46:02.618097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 653/1347] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:03.634305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:03.634909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:03.641057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:03.641493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:03.642239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:03.642657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:03.705629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:03.713703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a1faddb1-2d8d-4b30-8c46-4421c3e2af26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083061 Oct 28 15:46:03.714269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 695/1348] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:04.730070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:04.730697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:04.736907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:04.737357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:04.738124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:04.738555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:04.796911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:04.805650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9d393c27-5cb7-49b5-aea0-85e26046fe47 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079189 Oct 28 15:46:04.806206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 654/1349] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:05.823981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:05.824631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:05.831402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:05.831910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:05.832713 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:05.833143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:05.893258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:05.901036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cb10e427-08e8-4083-bfb5-14ff63ab3f6a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080663 Oct 28 15:46:05.901589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 696/1350] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:06.918160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:06.918788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:06.924974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:06.925410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:06.926191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:06.926615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:06.985229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:06.992727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0a45a78c-dff8-47dd-805d-f2f62fc3963d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078325 Oct 28 15:46:06.993273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 655/1351] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:08.009945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:08.010513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:08.016710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:08.017155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:08.017913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:08.018345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:08.080712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:08.088577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3dbee61e-5715-4cfb-aa3c-3cf85cbd8ec6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082349 Oct 28 15:46:08.089129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 697/1352] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:09.105752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:09.106318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:09.112580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:09.113040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:09.113800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:09.114233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:09.171650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:09.179248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c21bf3c1-26e9-4927-a8fc-5f6f3da60582 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077270 Oct 28 15:46:09.179843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 656/1353] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:10.195345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:10.199329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:10.202677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:10.203660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:10.204470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:10.204906 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:10.266998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:10.274613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-51e99bd9-d5e0-4106-9faa-c72b71e5c7d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083023 Oct 28 15:46:10.275169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 698/1354] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:11.291525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:11.292129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:11.298827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:11.299263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:11.300015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:11.300473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:11.358457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:11.369606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-97ade5c4-130d-4aff-ae88-84e91ec19904 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078787 Oct 28 15:46:11.369606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 657/1355] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:12.383485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:12.384071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:12.390205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:12.391261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:12.392004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:12.392450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:12.454165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:12.458235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2f78c2f4-ecaa-4850-9f75-b19d86dc63ff tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078353 Oct 28 15:46:12.458782 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 699/1356] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:13.475462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:13.475996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:13.482110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:13.482546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:13.483293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:13.483715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:13.541669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:13.549240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-56af4989-61b0-4d2e-9263-580b615ec280 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077512 Oct 28 15:46:13.549782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 658/1357] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:14.565984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:14.566586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:14.572720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:14.573153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:14.573896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:14.574319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:14.631957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:14.639430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4713c8b0-24d1-4516-951b-ca50c157e0b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077661 Oct 28 15:46:14.639983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 700/1358] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:15.657368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:15.657938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:15.664107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:15.665811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:15.665811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:15.665811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:15.733508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:15.742561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-086d005f-1125-4c5c-92fd-9495c95dc65b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.089474 Oct 28 15:46:15.743295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 659/1359] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:16.759121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:16.759742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:16.766385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:16.766828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:16.768597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:16.769105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:16.830594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:16.838420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5026f551-5415-4e41-a23a-cc36eaf16259 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083072 Oct 28 15:46:16.838975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 701/1360] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:17.855636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:17.856161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:17.862396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:17.862836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:17.863590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:17.864018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:17.921994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:17.929660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9d99d032-643a-4122-abfa-bf7ac32373fc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077796 Oct 28 15:46:17.930213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 660/1361] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:18.946384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:18.946981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:18.953162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:18.953602 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:18.954356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:18.954783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:19.014446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:19.022426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-479c138a-f9ff-49ea-9e1b-0a37f319c8e6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079793 Oct 28 15:46:19.023007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 702/1362] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:20.039410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:20.039999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:20.049461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:20.052579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:20.052579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:20.052579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:20.110000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:20.117586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b3cbe60e-d5ad-4cb5-aa9a-2f1b97e6e982 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082138 Oct 28 15:46:20.118139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 661/1363] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:21.133983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:21.134583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:21.140841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:21.141256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:21.142009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:21.142436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:21.200171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:21.207755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1693c0b9-8eab-4e74-91b7-21c3851086c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077467 Oct 28 15:46:21.208306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 703/1364] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:46:22.224273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:22.224921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:22.231206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:22.231651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:22.232441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:22.232877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:22.291560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:22.299973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-80d6bd43-5f9c-400f-a48f-9e426156c4ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079372 Oct 28 15:46:22.300564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 662/1365] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:23.316994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:23.317591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:23.323738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:23.324172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:23.324953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:23.325377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:23.387211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:23.395814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c667464e-2cea-4fd7-ac57-a720395ed06c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082465 Oct 28 15:46:23.396367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 704/1366] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:46:24.412509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:24.413133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:24.419262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:24.419699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:24.420477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:24.420907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:24.478676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:24.486166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1e783b4c-94f0-4100-ab12-301540cc1edd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077286 Oct 28 15:46:24.486722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 663/1367] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:25.502848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:25.503407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:25.509833 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:25.510466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:25.511228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:25.511653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:25.570219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:25.578370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-13221241-0538-4eea-8e71-a890f81ad1f7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079488 Oct 28 15:46:25.578925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 705/1368] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:26.595485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:26.596102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:26.602267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:26.602709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:26.603474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:26.603904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:26.662062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:26.669504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-993fd502-613e-4899-bdc2-2114cd0d5332 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078356 Oct 28 15:46:26.670254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 664/1369] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:27.687763 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:27.688371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:27.694622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:27.695065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:27.695820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:27.696247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:27.755119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:27.762854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b2f5c794-f592-44b1-81f6-b3ced4ce9b6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079411 Oct 28 15:46:27.763408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 706/1370] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:28.779267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:28.779874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:28.786604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:28.787048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:28.787814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:28.788246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:28.850786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:28.853689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-273cb20f-d7b8-447e-8ed5-0d56a6d0f403 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078139 Oct 28 15:46:28.854237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 665/1371] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:29.870433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:29.871023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:29.877622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:29.878066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:29.878825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:29.879252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:29.940382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:29.948248 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5841e267-8c72-493c-b850-d0c39afc6243 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081535 Oct 28 15:46:29.948838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 707/1372] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:30.965127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:30.965734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:30.971655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:30.972106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:30.972896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:30.973333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:31.031788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:31.039502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-27bc2ca1-99d2-44ee-8c12-4d4a32960b35 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078172 Oct 28 15:46:31.040055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 666/1373] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:32.056165 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:32.056802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:32.062791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:32.063234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:32.064563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:32.065223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:32.128131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:32.135679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cb4dd520-3507-45a1-ae4e-26f5d708b62a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083442 Oct 28 15:46:32.136235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 708/1374] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:33.152592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:33.153148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:33.159901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:33.160458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:33.161116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:33.161545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:33.219380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:33.227060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a7de22ed-ccf2-4191-af54-a0a35e65c0d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078177 Oct 28 15:46:33.227601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 667/1375] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:34.244043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:34.244686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:34.251663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:34.252359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:34.253135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:34.253553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:34.310413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:34.318599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-414f6c32-0115-4c83-8f93-fd94b2b76c6d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078229 Oct 28 15:46:34.319152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 709/1376] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:35.335108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:35.335711 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:35.342359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:35.342804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:35.343558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:35.343987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:35.401786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:35.409540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-97d04c4a-97cd-4154-a683-b084f26bb261 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078069 Oct 28 15:46:35.410083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 668/1377] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:36.424929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:36.425521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:36.431676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:36.432114 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:36.432893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:36.433319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:36.494599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:36.502619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37767f6d-fbe5-47d1-a5b1-e2ac9a0e242d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081377 Oct 28 15:46:36.503176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 710/1378] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:37.519889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:37.520472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:37.526607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:37.527041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:37.527795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:37.528219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:37.586896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:37.594558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-94b5e487-5175-4a10-8b1f-3491dfb3d3c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079060 Oct 28 15:46:37.595121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 669/1379] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:38.611467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:38.612078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:38.618404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:38.618841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:38.619599 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:38.620028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:38.678692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:38.686202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4dcd7009-a8fd-4ed0-9df9-6efaf6ba4350 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079060 Oct 28 15:46:38.686761 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 711/1380] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:39.703620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:39.704249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:39.710485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:39.710921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:39.711669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:39.712092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:39.771964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:39.779656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3181df74-b50b-48b3-8dcd-54d17968fcbe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080134 Oct 28 15:46:39.780205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 670/1381] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:40.795964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:40.797236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:40.804158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:40.804638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:40.805411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:40.805839 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:40.868281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:40.876114 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f3c5ea5-d03d-4499-95a2-600e05ff0ed2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083836 Oct 28 15:46:40.879347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 712/1382] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:41.892999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:41.893722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:41.899827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:41.900270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:41.901072 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:41.901508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:41.959391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:41.966991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4468c0d9-242c-4e09-ae65-1c51fd754df9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077663 Oct 28 15:46:41.967547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 671/1383] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:42.983954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:42.984591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:42.990849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:42.991290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:42.992052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:42.992525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:43.053443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:43.061214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c2dcdeef-f6c5-4259-b32a-2e45dae4686f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080920 Oct 28 15:46:43.061768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 713/1384] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:44.078479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:44.081262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:44.086345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:44.086790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:44.087572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:44.088002 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:44.150006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:44.157655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dd2dd218-3068-447d-9f70-64d172cf176b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083188 Oct 28 15:46:44.158206 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 672/1385] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:46:45.173970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:45.174565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:45.180822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:45.181261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:45.182011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:45.182432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:45.240472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:45.248011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1ff9b0b4-d1b8-4db6-ab67-911df0771525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077693 Oct 28 15:46:45.248592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 714/1386] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:46.265717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:46.266343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:46.272525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:46.272959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:46.273710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:46.274131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:46.331686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:46.339236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-68cbb8c8-0199-41b2-afbf-2626d13f009a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077201 Oct 28 15:46:46.339778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 673/1387] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:47.355424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:47.356023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:47.362487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:47.362929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:47.363724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:47.364159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:47.423252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:47.430911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3696373c-0397-4ad5-a31a-a10ac12a0fd6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079121 Oct 28 15:46:47.431468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 715/1388] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:48.447001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:48.448766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:48.455548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:48.455986 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:48.456788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:48.457212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:48.514835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:48.522887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aaacf4d4-9a3d-43a1-a5c9-3a89914642e2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079548 Oct 28 15:46:48.523433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 674/1389] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:49.539985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:49.540635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:49.547683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:49.548122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:49.548911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:49.549336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:49.610573 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:49.618126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8fb71967-3134-49ea-ba6f-dff30e9b1921 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081866 Oct 28 15:46:49.618679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 716/1390] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:50.639170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:50.639812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:50.646149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:50.646598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:50.647346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:50.647773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:50.707600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:50.715009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dc8014e9-937a-42bc-b362-043b4bf2fa7e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083904 Oct 28 15:46:50.715560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 675/1391] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:51.731992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:51.732619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:51.739758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:51.740193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:51.741003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:51.741423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:51.800771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:51.808524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3f061811-08e3-449a-a4f8-f970aac05166 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080173 Oct 28 15:46:51.809076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 717/1392] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:52.824972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:52.825569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:52.831714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:52.832151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:52.832939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:52.833367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:52.892272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:52.899871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-89632bb4-473b-4395-8efe-cd0fb140f7c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078554 Oct 28 15:46:52.900441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 676/1393] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:53.916969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:53.917590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:53.924471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:53.924912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:53.925669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:53.926098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:53.991972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:53.999829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e0bb72fa-c9ad-40eb-8112-f8413c135901 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086468 Oct 28 15:46:54.000319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 718/1394] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:55.017373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:55.017916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:55.023975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:55.024434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:55.025192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:55.025619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:55.082984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:55.090466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2ae1cabe-63f9-497c-86cb-2f84314a6fb2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077463 Oct 28 15:46:55.091012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 677/1395] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:56.106801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:56.107357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:56.114025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:56.114463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:56.115220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:56.115644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:56.183474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:56.191780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-abe526ce-80df-4995-8724-d4ce11519b9d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.088754 Oct 28 15:46:56.192337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 719/1396] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:57.208854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:57.209472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:57.215652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:57.216100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:57.216893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:57.217332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:57.275159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:57.282789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0080e871-58fb-4df6-908e-dd9d72242cea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077609 Oct 28 15:46:57.283343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 678/1397] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:58.299206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:58.299823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:58.306106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:58.306549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:58.307298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:58.307723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:58.366963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:58.374751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0eabeecc-8d78-4888-bed1-ad5b3f0aa245 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079295 Oct 28 15:46:58.375307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 720/1398] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:46:59.392093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:46:59.392685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:46:59.403652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:59.404108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:59.404926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:46:59.405356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:46:59.466224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:46:59.473839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-826edfe9-ac54-442e-a29d-0fce78310de1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086111 Oct 28 15:46:59.474384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 679/1399] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:46:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:00.490362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:00.490964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:00.497199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:00.497639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:00.498401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:00.498829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:00.558995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:00.567607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-294542bc-f8ac-476d-b62b-f8bec01b843e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080948 Oct 28 15:47:00.568171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 721/1400] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:01.584143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:01.584735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:01.590648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:01.591091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:01.591855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:01.592286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:01.649436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:01.656938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1b9ac4e8-fed8-46d4-9db9-cc8c7087c82f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.076575 Oct 28 15:47:01.657494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 680/1401] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:02.673832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:02.674451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:02.680322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:02.680793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:02.681553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:02.681980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:02.742963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:02.751581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9a6d4fe4-786a-4fd9-848d-3eef6bdb72ce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081682 Oct 28 15:47:02.752817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 722/1402] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:03.769386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:03.769992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:03.776192 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:03.776658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:03.777429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:03.777849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:03.836554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:03.844070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f8652121-eeed-4a22-9092-e55cf224adb0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078988 Oct 28 15:47:03.852565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 681/1403] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:04.860970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:04.861561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:04.868013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:04.868474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:04.869229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:04.869657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:04.928052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:04.935586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f97e86f5-472f-4b38-b5e0-130ce52d09b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078342 Oct 28 15:47:04.936134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 723/1404] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:05.951856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:05.952495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:05.958741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:05.959187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:05.959953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:05.960405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:06.020027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:06.027634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b3c43b97-ceaa-443b-b36b-89cb7308d3bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079458 Oct 28 15:47:06.028186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 682/1405] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:07.044550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:07.045124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:07.051960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:07.052412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:07.053212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:07.053645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:07.111512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:07.119110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7a48f535-e9ce-445c-852d-4e416f93b8e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078367 Oct 28 15:47:07.119662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 724/1406] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:08.139361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:08.139941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:08.148125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:08.148603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:08.149384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:08.149822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:08.216524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:08.224634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-efe1956a-6b48-40b1-8ce0-0933d762b0e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.089904 Oct 28 15:47:08.225187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 683/1407] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:09.240972 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:09.241573 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:09.247728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:09.248161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:09.248950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:09.249367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:09.310491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:09.318070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cbce7a79-65d5-4b22-a092-0ce8297bd525 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080765 Oct 28 15:47:09.318618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 725/1408] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:10.334968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:10.335632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:10.341813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:10.342255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:10.343021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:10.343452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:10.401630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:10.409850 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ceebe2d8-90c8-4132-9690-a40e4f0ca8ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078566 Oct 28 15:47:10.410404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 684/1409] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:11.426897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:11.427545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:11.433845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:11.434279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:11.435033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:11.435455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:11.493517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:11.501418 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c2612b89-0f73-48b5-8595-1bc72a225118 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077961 Oct 28 15:47:11.502002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 726/1410] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:12.517974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:12.518575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:12.524795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:12.525242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:12.526003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:12.526434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:12.584809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:12.592490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-df8c6a81-bfcf-4ec8-8533-d9747547aa0b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078216 Oct 28 15:47:12.593100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 685/1411] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:13.608976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:13.610102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:13.616160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:13.616624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:13.617377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:13.617794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:13.676995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:13.684679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b907d16d-cca6-4207-bc64-6edbad56e925 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079440 Oct 28 15:47:13.685239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 727/1412] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:14.701234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:14.701830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:14.708276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:14.708742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:14.709514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:14.709945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:14.768532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:14.781897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3b191864-d184-4665-ba9b-ea5e11403af1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084269 Oct 28 15:47:14.782506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 686/1413] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:15.800219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:15.800837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:15.807070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:15.807506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:15.808261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:15.808719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:15.872153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:15.880222 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fac1b746-a34c-454c-a8fe-3ea6666378a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084370 Oct 28 15:47:15.880811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 728/1414] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:16.896568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:16.897185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:16.903486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:16.903929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:16.904719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:16.905152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:16.962774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:16.970560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2192876d-8021-4fe9-8100-d45a8d4d7aa2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077731 Oct 28 15:47:16.971114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 687/1415] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:17.987594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:17.988202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:17.994379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:17.994813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:17.995564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:17.995987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:18.054411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:18.061992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-aae1a0ad-8fde-46f9-bb16-50cbc7bf0db9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078687 Oct 28 15:47:18.063085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 729/1416] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:19.077916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:19.078543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:19.084743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:19.085188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:19.085953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:19.086380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:19.145132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:19.152701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-19119a11-4ec7-4210-993e-d83f761b49ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078384 Oct 28 15:47:19.153249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 688/1417] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:20.169902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:20.170516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:20.184168 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:20.184655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:20.185407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:20.185827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:20.252043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:20.259789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f0920c18-998d-4b8b-9aac-9253bf40f195 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.094133 Oct 28 15:47:20.260349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 730/1418] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:47:21.275911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:21.276504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:21.282694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:21.283143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:21.283905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:21.284334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:21.343465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:21.351025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fdce14be-9c50-4027-88f5-5f4765fc90d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079087 Oct 28 15:47:21.351576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 689/1419] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:22.368008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:22.368677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:22.375496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:22.376183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:22.376968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:22.377400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:22.439100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:22.446838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c07c8347-3a3a-4738-b196-cb8e2b62563e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082524 Oct 28 15:47:22.447391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 731/1420] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:23.463881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:23.464518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:23.471393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:23.471840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:23.472634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:23.473068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:23.537201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:23.544984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1e9220d5-fa40-4a97-9b84-db43ab12acdc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084780 Oct 28 15:47:23.545549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 690/1421] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:24.562123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:24.562718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:24.569312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:24.570118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:24.571305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:24.571736 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:24.629635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:24.637255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-85629e77-04e1-4dc8-8c82-469b6b51d6cc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078818 Oct 28 15:47:24.637809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 732/1422] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:25.654104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:25.654906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:25.661170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:25.661619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:25.662379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:25.662811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:25.720727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:25.728351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-45ffc983-65c3-4d9e-aaa5-f9a6868a469a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078039 Oct 28 15:47:25.728932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 691/1423] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:26.744983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:26.745591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:26.752422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:26.752898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:26.753669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:26.754097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:26.814731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:26.822574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e3fc9aff-a3b0-494a-a557-4a83c2aab7c0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081379 Oct 28 15:47:26.823121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 733/1424] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:27.840025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:27.847739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:27.847739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:27.847998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:27.848601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:27.849032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:27.914221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:27.922546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a5630c8e-5a54-4fa0-bab5-0dce2b4b2848 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086213 Oct 28 15:47:27.923091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 692/1425] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:28.939563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:28.940142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:28.946364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:28.946800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:28.947581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:28.948012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:29.010660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:29.018887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a4f52669-3ef5-4247-aa62-38dd3083466d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083573 Oct 28 15:47:29.019438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 734/1426] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:30.035456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:30.036059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:30.042277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:30.042727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:30.043495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:30.043930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:30.326285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:30.334014 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a8f34b39-8ee8-4be0-8cbf-5d17323386ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.302938 Oct 28 15:47:30.334561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 693/1427] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:31.350377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:31.350976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:31.357198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:31.357628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:31.358366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:31.358785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:31.417034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:31.424761 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-575df213-2835-4377-91c9-0272071529c1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077981 Oct 28 15:47:31.425322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 735/1428] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:32.440728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:32.443364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:32.447616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:32.448063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:32.448860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:32.449290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:32.507359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:32.515063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c5a3c705-cf3d-425f-a53d-8804722d98c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078109 Oct 28 15:47:32.515610 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 694/1429] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:33.531755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:33.532293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:33.535540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:47:33.535961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:47:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:47:33.538609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:33.539050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:33.539812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:33.540241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:33.603020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:33.614014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ae3db946-be5c-4bbd-a2f6-1793f6304e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085971 Oct 28 15:47:33.614597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 736/1430] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:34.631205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:34.631757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:34.637976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:34.638422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:34.639189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:34.639623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:34.702002 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:34.710203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e0bf2055-7799-4fdb-945c-d7409c75c735 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082745 Oct 28 15:47:34.710756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 695/1431] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:35.726700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:35.727151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:35.734425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:35.734799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:35.735557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:35.735979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:35.803380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:35.809916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2be05606-1f32-4933-b607-663d2d3387b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086879 Oct 28 15:47:35.810469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 737/1432] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:36.827026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:36.828185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:36.834598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:36.835044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:36.835812 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:36.836242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:36.899588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:36.908344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-90795bce-31c1-44c0-95f5-4dc469d64c39 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085030 Oct 28 15:47:36.908961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 696/1433] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:37.925669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:37.926273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:37.932626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:37.933069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:37.933826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:37.934253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:37.994687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:38.003091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-79d67194-bc35-4587-b891-cad5fa27b1dc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081153 Oct 28 15:47:38.003641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 738/1434] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:39.020157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:39.020754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:39.026912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:39.027358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:39.028123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:39.028597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:39.086179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:39.093754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-02ec68b3-8f35-47e0-b826-c1674a2ae1f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077378 Oct 28 15:47:39.094306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 697/1435] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:40.330955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:47:40.331466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:47:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 (ip 10.222.0.86) !!! Oct 28 15:47:40.354694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:40.355289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:40.361020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:40.361462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:40.362254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:40.362627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:40.421197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:40.431411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3ff44bd5-1a1e-4515-af68-869128164fa3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.325807 Oct 28 15:47:40.431977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 739/1436] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:40.696114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:47:40.697662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:47:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:47:41.448782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:41.449385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:41.455995 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:41.456469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:41.457232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:41.457661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:41.516414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:41.524210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9204e81c-0eb1-448b-804c-400070bd5bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079620 Oct 28 15:47:41.524780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 698/1437] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:42.541305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:42.541925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:42.548725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:42.549166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:42.549915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:42.550343 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:42.608657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:42.620410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0b6fb891-9de6-4183-bfb4-f4926b004385 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082726 Oct 28 15:47:42.621053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 740/1438] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:47:43.638555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:43.639075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:43.645927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:43.646374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:43.647152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:43.647566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:43.705419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:43.712993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bb1c76e4-48c4-444d-b289-4611b1bc5f59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078204 Oct 28 15:47:43.713542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 699/1439] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:44.728768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:44.729404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:44.736687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:44.737136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:44.737897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:44.738327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:44.803234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:44.810797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-77b8b9a9-a51b-4fd3-9c50-c2a6c8dafc6c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085783 Oct 28 15:47:44.811390 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 741/1440] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:45.827405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:45.828013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:45.834323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:45.834765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:45.835533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:45.835965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:45.894699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:45.902623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-164230f2-db54-4e8b-abb1-923eb1e9f221 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079482 Oct 28 15:47:45.903184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 700/1441] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:46.918709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:46.919337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:46.925618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:46.926086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:46.926847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:46.927275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:46.985218 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:46.992841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-74bcd507-1514-44a5-948e-85cc8662ad8c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077811 Oct 28 15:47:46.993341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 742/1442] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:48.009137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:48.009707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:48.016459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:48.016908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:48.017673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:48.018102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:48.075842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:48.084334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7a9821b0-4bd9-44cc-a77e-ece217f494f5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078763 Oct 28 15:47:48.084926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 701/1443] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:49.100705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:49.101382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:49.107560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:49.107995 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:49.108856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:49.109203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:49.167926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:49.175618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1c85429a-5dca-4508-b309-17f5a432b5b6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078725 Oct 28 15:47:49.176175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 743/1444] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:50.192457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:50.193068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:50.199260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:50.199706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:50.200501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:50.200939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:50.260075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:50.268423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3afd0364-9af2-46d5-996a-442d2129e2da tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079683 Oct 28 15:47:50.268982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 702/1445] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:51.285384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:51.285937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:51.292141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:51.292610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:51.293357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:51.293779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:51.355930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:51.363660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6eb6c057-1e79-43f8-96ed-e0353b681f62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082009 Oct 28 15:47:51.364206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 744/1446] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:52.380142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:52.380809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:52.386991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:52.387437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:52.388191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:52.388650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:52.449097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:52.454186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-87e92053-81e1-45a9-96df-c2d1784e148e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077675 Oct 28 15:47:52.454737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 703/1447] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:53.471062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:53.471695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:53.478219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:53.478655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:53.479406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:53.479834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:53.537752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:53.545866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bc829fe5-ab0d-4731-b968-84e884330386 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079005 Oct 28 15:47:53.546414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 745/1448] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:54.562419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:54.563043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:54.569251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:54.569691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:54.570447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:54.570878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:54.642773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:54.650519 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e5c675f3-a60e-47b0-a26b-2ff673485b26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.091763 Oct 28 15:47:54.651069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 704/1449] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:55.667513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:55.668122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:55.674462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:55.674902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:55.675661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:55.676090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:55.733715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:55.741502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0efb7159-85d4-4e03-b556-1f859268aec5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077649 Oct 28 15:47:55.742057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 746/1450] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:56.758929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:56.759677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:56.766047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:56.766491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:56.767254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:56.767685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:56.826402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:56.835079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-afde65ea-d453-4be8-99fe-a6c8889062b4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079883 Oct 28 15:47:56.835626 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 705/1451] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:57.851579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:57.854546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:57.858829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:57.859279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:57.860043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:57.860654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:57.923772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:57.931494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fee0c8d5-9437-4231-bce8-5ffce3e53284 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083669 Oct 28 15:47:57.932045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 747/1452] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:47:58.948418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:47:58.949037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:47:58.955829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:58.956271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:58.957065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:47:58.957499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:47:59.015872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:47:59.023504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b28b5841-e532-4dd3-b8b3-374e917c07d2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078787 Oct 28 15:47:59.024058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 706/1453] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:47:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:00.040725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:00.041260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:00.047573 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:00.048017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:00.051296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:00.051296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:00.106998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:00.114657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e68177a6-9a5d-4933-8066-e62c398e247e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077708 Oct 28 15:48:00.115207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 748/1454] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:01.131489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:01.132051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:01.137895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:01.138333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:01.139093 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:01.139521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:01.196654 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:01.204224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7c0dcf8c-4539-412f-b8b4-fb868704c769 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.076448 Oct 28 15:48:01.204806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 707/1455] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:02.221741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:02.222354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:02.228156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:02.228635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:02.229394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:02.229824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:02.287633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:02.295927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9332ae9-eac9-4f13-a4e5-b56c655ea2c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078316 Oct 28 15:48:02.296501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 749/1456] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:03.312528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:03.313132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:03.319346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:03.319793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:03.320587 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:03.321022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:03.379613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:03.387581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3a7b07dd-071b-49b9-b319-37b59b9370a3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078789 Oct 28 15:48:03.388731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 708/1457] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:03.389983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:48:03.390455 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:48:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:48:04.405190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:04.406422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:04.414642 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:04.415076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:04.415832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:04.416283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:04.482774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:04.490341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eea84d2e-058b-4d76-8352-f5adddc19952 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.089433 Oct 28 15:48:04.490912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 750/1458] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:05.506950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:05.507484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:05.514263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:05.514700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:05.515449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:05.515877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:05.575147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:05.582753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d7d1cf97-2314-4b9e-b737-e09649cf5ea7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079578 Oct 28 15:48:05.583301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 709/1459] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:06.599307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:06.599910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:06.615876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:06.616316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:06.617105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:06.617656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:06.676741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:06.684996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0787b186-c65b-41cc-91e0-15eb30194d5d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.088863 Oct 28 15:48:06.685549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 751/1460] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:07.701690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:07.702288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:07.708526 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:07.708968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:07.709718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:07.710143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:07.768761 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:07.776734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c125ada3-0df9-4fcc-9d6a-9cdbca67f9aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079235 Oct 28 15:48:07.777277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 710/1461] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:08.793066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:08.793666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:08.800334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:08.800799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:08.801543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:08.801962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:08.859581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:08.867765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-972f6ecf-9944-4b36-9adb-e06b502890e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078388 Oct 28 15:48:08.868305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 752/1462] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:09.885410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:09.886044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:09.892247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:09.893083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:09.893527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:09.894225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:09.952426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:09.960094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-59d7297b-5382-481b-8a99-ce75caf87cd0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078413 Oct 28 15:48:09.960684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 711/1463] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:48:10.977280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:10.977880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:10.983948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:10.984378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:10.985149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:10.985567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:11.047258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:11.054917 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9d54e70f-1548-40cf-a35d-86b953c124e3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081640 Oct 28 15:48:11.055465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 753/1464] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:12.070691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:12.071266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:12.077449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:12.077898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:12.078663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:12.079097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:12.137300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:12.144875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6da50163-5fcc-4243-9824-c5e50cd556b9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077947 Oct 28 15:48:12.145430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 712/1465] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:13.161835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:13.162391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:13.169245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:13.169688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:13.170485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:13.170910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:13.230001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:13.238080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3239600c-0465-4abb-b320-5db96912ec54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080081 Oct 28 15:48:13.238637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 754/1466] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:14.255233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:14.255837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:14.262042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:14.263100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:14.263859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:14.264288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:14.321266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:14.329678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb446e01-6b7c-4dc1-b443-473fa04b1b0c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078105 Oct 28 15:48:14.330227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 713/1467] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:15.345474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:15.346087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:15.352621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:15.353066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:15.356488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:15.356488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:15.413924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:15.422126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c3146405-0659-4a80-b65a-9d009724eba6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080461 Oct 28 15:48:15.422677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 755/1468] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:16.094158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:48:16.094377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:48:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:48:16.440323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:16.441499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:16.447856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:16.448302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:16.449096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:16.449531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:16.507856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:16.515493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-08a179d5-880a-43d6-8df8-a67248059dfc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080528 Oct 28 15:48:16.516046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 714/1469] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:17.532427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:17.532986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:17.539185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:17.539628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:17.540400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:17.540834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:17.603300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:17.611011 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-64ee6dc0-5f10-4dd5-b87d-3bddab271cb7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082381 Oct 28 15:48:17.611591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 756/1470] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:18.627162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:18.627765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:18.633903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:18.634336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:18.635083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:18.635505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:18.695594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:18.703739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-45bab6ac-30f9-4c4a-afac-2bd20386d4f2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080516 Oct 28 15:48:18.704282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 715/1471] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:19.720527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:19.721127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:19.727270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:19.727707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:19.728480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:19.728909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:19.787025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:19.794994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7219a2ba-6eb7-4c10-becb-19e92a7aa810 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078085 Oct 28 15:48:19.795540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 757/1472] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:20.811972 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:20.812600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:20.818777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:20.819218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:20.819981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:20.820438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:20.878622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:20.887889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-52b787b9-73bb-4476-af3c-bab007d0d66d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079405 Oct 28 15:48:20.890222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 716/1473] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:21.904139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:21.904781 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:21.911057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:21.911499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:21.912250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:21.912706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:21.973207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:21.981584 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-053b4097-e40e-4d88-bf5a-5629c3e252ee tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081635 Oct 28 15:48:21.982137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 758/1474] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:22.998957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:22.999534 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:23.005940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:23.006386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:23.007143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:23.007574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:23.067289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:23.075084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-badf72ef-874a-4a2a-9841-7c4d2abbef92 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080534 Oct 28 15:48:23.075627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 717/1475] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:24.090880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:24.091445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:24.097614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:24.098058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:24.098822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:24.099252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:24.160893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:24.168600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-10cc6a79-4fda-48d9-9d19-677ae5426a58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081510 Oct 28 15:48:24.169152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 759/1476] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:25.184854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:25.185463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:25.191637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:25.192089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:25.192913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:25.193347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:25.251260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:25.258853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c829e109-74d7-41ad-a68f-f84af9fb88c6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077668 Oct 28 15:48:25.259407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 718/1477] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:26.279702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:26.280313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:26.286516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:26.286960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:26.287720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:26.288148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:26.346370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:26.353913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d3c16aa4-4f4b-479f-823d-a033b4409679 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078466 Oct 28 15:48:26.354465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 760/1478] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:27.371089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:27.371694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:27.378170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:27.378647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:27.379410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:27.379842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:27.437651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:27.445159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b4e56092-e0de-42fa-95b0-26a228841fb8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077855 Oct 28 15:48:27.445707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 719/1479] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:28.461993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:28.462600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:28.469338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:28.469789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:28.470545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:28.470969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:28.530967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:28.538581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e475d2cf-3dff-42bb-b1b2-c6baf2eeaed6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080270 Oct 28 15:48:28.539135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 761/1480] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:29.555868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:29.556437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:29.563250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:29.563712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:29.564491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:29.564921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:29.622681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:29.630473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-35cb7954-47b2-442a-9ffa-d3d913a07edc tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078331 Oct 28 15:48:29.631028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 720/1481] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:30.646845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:30.647470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:30.654203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:30.654665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:30.655419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:30.655841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:30.717888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:30.725543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7308ad1b-d26f-469d-a92c-7c109ac5c4bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082392 Oct 28 15:48:30.726103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 762/1482] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:31.742540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:31.743620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:31.750522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:31.750988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:31.751746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:31.752172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:31.812141 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:31.819946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-10303753-5f8c-45ff-a915-9dec6d5fd751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081105 Oct 28 15:48:31.820509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 721/1483] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:32.836440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:32.837073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:32.842819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:32.843254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:32.843994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:32.844434 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:32.903497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:32.911167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-813f1a01-c311-4f7d-8cd8-4044b9f635f4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078589 Oct 28 15:48:32.911722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 763/1484] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:33.928241 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:33.929006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:33.935521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:33.935970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:33.936811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:33.937235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:33.997090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:34.004887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a98f07a6-a17c-4c33-8d70-6311f4f6229b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080339 Oct 28 15:48:34.005441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 722/1485] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:35.021492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:35.022053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:35.028164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:35.028625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:35.029389 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:35.029787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:35.087644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:35.095299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a5203ed9-0fc6-4638-86d0-5843461134c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077582 Oct 28 15:48:35.095849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 764/1486] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:36.111160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:36.111688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:36.117934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:36.118413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:36.119179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:36.119611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:36.178322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:36.185894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-30f63756-3524-4aa1-bfc3-3ebf736392d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078438 Oct 28 15:48:36.186447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 723/1487] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:37.202065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:37.202669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:37.208890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:37.209327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:37.210076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:37.210501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:37.272350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:37.280185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-af20f19f-e354-4a33-8fdc-fc3a9d228ebe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081750 Oct 28 15:48:37.280768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 765/1488] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:38.297309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:38.297907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:38.304123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:38.304614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:38.305380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:38.305811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:38.364273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:38.372473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-187dff43-a478-4f67-8842-677ca4c984d1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078846 Oct 28 15:48:38.373034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 724/1489] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:39.390033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:39.391192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:39.397347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:39.397793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:39.398556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:39.398985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:39.457145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:39.465383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6398c52b-eb16-488c-a7ca-db6b2d6464ea tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079880 Oct 28 15:48:39.465934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 766/1490] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:40.481379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:40.482020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:40.488369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:40.488843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:40.489607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:40.490039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:40.549553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:40.557210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f4112fa3-8997-4904-a400-8303e83bbd62 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080042 Oct 28 15:48:40.557779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 725/1491] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:41.573268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:41.573931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:41.580526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:41.580961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:41.581706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:41.582126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:41.643510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:41.653979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-da7d5107-ec23-4edb-9164-8ffcc0c7fa18 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084531 Oct 28 15:48:41.654532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 767/1492] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:48:42.671758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:42.672375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:42.678539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:42.678984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:42.679747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:42.680180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:42.738193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:42.745989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-275a1e03-cb4f-4f4d-b3ce-d06c45e68aba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077839 Oct 28 15:48:42.746541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 726/1493] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:43.763060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:43.763776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:43.769970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:43.770403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:43.771150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:43.771567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:43.834201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:43.842395 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-24f55faa-8907-4021-988a-220f78595950 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083509 Oct 28 15:48:43.842940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 768/1494] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:44.858713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:45.020904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:45.020904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:45.020904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:45.020904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:45.021678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:45.021678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:45.021678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0c5d4b41-1fee-46cd-99ec-5d8562560c83 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079673 Oct 28 15:48:45.021678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 727/1495] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:45.950829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:45.951433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:45.957672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:45.958111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:45.958874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:45.959304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:46.018027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:46.025705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7bf50bab-2f84-4542-8757-4246c47e5f23 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078599 Oct 28 15:48:46.026925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 769/1496] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:47.042225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:47.042727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:47.049038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:47.049482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:47.050244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:47.050673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:47.108749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:47.116346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8e8807eb-ec26-40e8-8e84-3cbecc98d2b0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078031 Oct 28 15:48:47.116930 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 728/1497] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:48.133367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:48.133898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:48.140766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:48.141286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:48.142050 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:48.142502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:48.202124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:48.209909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-60bf0baa-b6fb-4908-8231-6456958fef59 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080421 Oct 28 15:48:48.210462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 770/1498] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:49.226504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:49.227111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:49.234347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:49.234790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:49.235552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:49.235983 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:49.299504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:49.307712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-53778193-c1d1-4669-9ad3-77d9264499fb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084270 Oct 28 15:48:49.308265 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 729/1499] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:50.324189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:50.324824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:50.331074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:50.331515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:50.332276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:50.332739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:50.394163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:50.402615 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-452ab757-d536-4d88-bd04-98d8e8af316c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082073 Oct 28 15:48:50.403170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 771/1500] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:51.419444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:51.420045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:51.426292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:51.426739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:51.427496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:51.427922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:51.486201 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:51.493775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e8a6c09f-9407-4663-a719-8f3733497caf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078568 Oct 28 15:48:51.495008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 730/1501] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:52.510339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:52.510945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:52.517210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:52.517648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:52.518404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:52.518831 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:52.578098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:52.585873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-db080930-17e4-4940-9695-e54d278c4e85 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079276 Oct 28 15:48:52.586428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 772/1502] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:53.602831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:53.603353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:53.610327 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:53.610784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:53.611892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:53.612734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:53.674006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:53.681684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-29b44fe9-c167-4a2b-8985-71537dc6a789 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082559 Oct 28 15:48:53.682263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 731/1503] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:54.698009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:54.698622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:54.704862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:54.705301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:54.706057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:54.706482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:54.769337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:54.777869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0a1bfa2e-fa98-4a22-9812-ef56509dc919 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083521 Oct 28 15:48:54.778446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 773/1504] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:55.794668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:55.795278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:55.801492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:55.801924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:55.802676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:55.803096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:55.860746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:55.868558 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7ae49a42-cee3-4e0b-b5d5-c808ee9d4def tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077971 Oct 28 15:48:55.869156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 732/1505] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:56.886249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:56.886855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:56.893341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:56.893790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:56.894590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:56.895020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:56.958344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:56.966679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4c75a6da-832d-4898-9fdd-7a01f794b90e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084232 Oct 28 15:48:56.967237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 774/1506] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:48:57.983019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:57.983791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:57.990250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:57.990692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:57.991449 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:57.991877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:58.050614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:58.058811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e4664d72-b836-46f7-966c-4299118a0bce tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079388 Oct 28 15:48:58.059314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 733/1507] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:59.075288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:59.075891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:59.082637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.083086 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.083858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.084289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.145617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:48:59.154102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0f1210f4-64d8-4cc7-81a2-f792125fcbe4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083125 Oct 28 15:48:59.154666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 775/1508] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:48:59.465967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:59.466608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:59.473189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.473631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.474490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.474919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.488422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. Oct 28 15:48:59.489000 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:48:59.489804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b0a37beb-a002-4ba9-a1e1-489e09b32ee6 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 404 len: 111 microversion: 2.1 time: 0.028022 Oct 28 15:48:59.490324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 734/1509] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:48:59 2021] DELETE /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:48:59.498302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:48:59.499180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] [instance: cc888dd6-aa57-4e8e-9d1b-9a38b32f3597] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:48:59.504857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.505299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.506054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:48:59.506480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:48:59.519758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] HTTP exception thrown: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. Oct 28 15:48:59.520327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] Returning 404 to user: Instance cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:48:59.521145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-07cf5696-482b-4a11-ac95-8cc8ff09bf41 tempest-AttachVolumeShelveTestJSON-2084419960 tempest-AttachVolumeShelveTestJSON-2084419960-project] 10.222.0.86 "GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597" status: 404 len: 111 microversion: 2.1 time: 0.026513 Oct 28 15:48:59.521649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 776/1510] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:48:59 2021] GET /compute/v2.1/servers/cc888dd6-aa57-4e8e-9d1b-9a38b32f3597 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:49:00.170818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:00.171425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:00.177351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:00.177791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:00.178567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:00.178996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:00.250176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:00.257924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bdf28c69-e669-44fc-8442-8c515c1868f6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.090906 Oct 28 15:49:00.258424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 735/1511] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:01.275026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:01.275535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:01.281761 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:01.282410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:01.283182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:01.283613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:01.348779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:01.357634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e062da87-3188-4a15-a536-8c8313f5b698 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086403 Oct 28 15:49:01.358221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 777/1512] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:02.376146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:02.376790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:02.383387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:02.389738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:02.389738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:02.390130 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:02.479946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:02.487840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e949c6bd-a731-4624-a316-46a835632648 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.116738 Oct 28 15:49:02.488416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 736/1513] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:03.505412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:03.506113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:03.512000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:03.512560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:03.513458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:03.513891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:03.575299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:03.583206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e248636-be0c-44ab-9a4b-a5453e5e221e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081645 Oct 28 15:49:03.583767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 778/1514] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:04.599316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:04.600162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:04.609624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:04.610365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:04.611197 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:04.611622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:04.672699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:04.680190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a56d6a89-fdf2-46c5-90c9-18d3dbf722e7 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084503 Oct 28 15:49:04.680768 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 737/1515] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:05.697722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:05.698321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:05.704467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:05.704912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:05.705665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:05.706089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:05.768999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:05.777469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9ca591cd-43cb-40ea-8370-54b0ad1b32a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083954 Oct 28 15:49:05.778023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 779/1516] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:06.210407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784837739", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "d24ae9ef-f446-4a47-88b9-f91bd62a5742"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:49:06.262492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] validate_networks() for [('d24ae9ef-f446-4a47-88b9-f91bd62a5742', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:49:06.645314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:49:06.645724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:49:06.646185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:49:06.646580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:49:06.646975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:49:06.656038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:06.656575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:06.657355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:06.657775 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:06.674295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:49:06.678123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for user 7f4be8e5a4a84fa884ba59a98820d5aa and project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:49:06.688345 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:49:06.690633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:49:06.794660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:06.795265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:06.801397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:06.801838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:06.802594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:06.803020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:06.820028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-26ea0dd4-3cc5-47c0-bb6a-d699bfb9204c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720279 Oct 28 15:49:06.825830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 738/1517] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:49:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:49:06.830556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c6fb3ce8-3992-4890-ad98-51942507e311 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:06.831166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c6fb3ce8-3992-4890-ad98-51942507e311 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:07.109732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:07.117984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1149531a-b603-4cf7-bcba-469e37a9fc56 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.327636 Oct 28 15:49:07.122963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 780/1518] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:49:07.123335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c6fb3ce8-3992-4890-ad98-51942507e311 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:07.130589 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c6fb3ce8-3992-4890-ad98-51942507e311 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1218 microversion: 2.1 time: 0.303791 Oct 28 15:49:07.131202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 739/1519] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:06 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:49:08.136115 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:08.136780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:08.143204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:08.143646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:08.144485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:08.144921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:08.147451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:08.148223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:08.155377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:08.155906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:08.156777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:08.157308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:08.211318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:08.219493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-17123c4f-a1a1-4fa7-bff2-2545df6be52a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.088250 Oct 28 15:49:08.220052 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 781/1520] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:49:08.234967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:08.242194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b3a58c2b-05d6-448f-be2d-9007461639c8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1222 microversion: 2.1 time: 0.098637 Oct 28 15:49:08.242739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 740/1521] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:08 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:49:09.236192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:09.236863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:09.243621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:09.244662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:09.245442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:09.245873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:09.258611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:09.259799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:09.266742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:09.267242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:09.268009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:09.268451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:09.309681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:09.317953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e2786d92-2111-43dd-ada0-18b52f99282b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085490 Oct 28 15:49:09.318754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 782/1522] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:09.339510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:09.349026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-07c739c0-5869-4fb6-8469-98533d5ce224 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1288 microversion: 2.1 time: 0.093703 Oct 28 15:49:09.350007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 741/1523] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:09 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:49:10.335367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:10.335961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:10.342299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:10.342735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:10.343551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:10.343969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:10.367006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:10.369038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:10.375922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:10.376684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:10.377455 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:10.377884 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:10.412438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:10.421264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2cf4258b-0a0e-42a5-80f3-f365a21c7a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.089487 Oct 28 15:49:10.422163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 783/1524] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:10.498285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:10.505982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b736f730-530f-4e97-9a48-5344f12fc19c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.143553 Oct 28 15:49:10.506638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 742/1525] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:10 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:10.690394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-b96b8825-b3c4-4b1d-bc7f-334b5becfd97 req-a2034a6e-4cba-4b3c-a19e-e387b8c287f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b88e85-cf04-4bb9-889d-bd9f2846e583", "tag": "467c0f2a-2891-4497-94f8-386341a69775"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:49:10.691980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:49:10.691980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:49:10.701316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-b96b8825-b3c4-4b1d-bc7f-334b5becfd97 req-a2034a6e-4cba-4b3c-a19e-e387b8c287f3 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:10.701787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-b96b8825-b3c4-4b1d-bc7f-334b5becfd97 req-a2034a6e-4cba-4b3c-a19e-e387b8c287f3 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:10.713845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-b96b8825-b3c4-4b1d-bc7f-334b5becfd97 req-a2034a6e-4cba-4b3c-a19e-e387b8c287f3 service nova] Creating event network-changed:467c0f2a-2891-4497-94f8-386341a69775 for instance 64b88e85-cf04-4bb9-889d-bd9f2846e583 on hv-cinder-78364 Oct 28 15:49:10.719780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-b96b8825-b3c4-4b1d-bc7f-334b5becfd97 req-a2034a6e-4cba-4b3c-a19e-e387b8c287f3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097604 Oct 28 15:49:10.720462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 784/1526] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:49:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:49:11.436870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:11.437473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:11.443836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:11.444153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:11.444946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:11.445372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:11.507252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:11.515442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-80775a8f-6be2-41d5-9095-25f317d287e1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082149 Oct 28 15:49:11.516224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 743/1527] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:11.523896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:11.524626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:11.531387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:11.531870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:11.532883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:11.533317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:11.657622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:11.664836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ec3628f9-a236-414b-ab97-4ee180c0a5cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.146401 Oct 28 15:49:11.665412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 785/1528] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:11 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:12.532473 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:12.533105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:12.539350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:12.539795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:12.540592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:12.541024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:12.599031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:12.606614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-65deca44-ee36-4dd3-ab4a-980c3b166c2a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077887 Oct 28 15:49:12.607163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 744/1529] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:12.680346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:12.681082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:12.687873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:12.688310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:12.689101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:12.689525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:12.806289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:12.813919 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-246b0feb-91a5-479c-a8c2-7646b66a9377 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.137212 Oct 28 15:49:12.814469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 786/1530] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:12 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:13.622530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:13.623088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:13.629584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:13.630023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:13.630777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:13.631203 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:13.690445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:13.698774 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3f044897-fe7b-4fea-b072-05f2533e17ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080423 Oct 28 15:49:13.699329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 745/1531] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:13.830647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:13.831251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:13.837433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:13.837869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:13.838617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:13.839048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:13.959462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:13.966558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a490c97d-046d-42c6-a128-e6a9186a5879 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.139566 Oct 28 15:49:13.967112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 787/1532] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:13 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:14.716091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:14.716739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:14.723052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:14.723484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:14.724316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:14.724766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:14.783337 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:14.791229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4af708b4-7768-4c7f-a6a2-7bcb1e32163f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079745 Oct 28 15:49:14.791790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 746/1533] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:14.982756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:14.983354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:14.989504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:14.989940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:14.990717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:14.991147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:15.114788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:15.122667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-07ec1c0d-aa73-45c2-b143-951a39faec0b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.143548 Oct 28 15:49:15.123236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 788/1534] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:14 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:15.808218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:15.808849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:15.814974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:15.815406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:15.816157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:15.816619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:15.877634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:15.885317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a8972768-2fce-4e45-8cff-78ea0e76ba2f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080815 Oct 28 15:49:15.885907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 747/1535] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:16.139136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:16.139663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:16.145886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:16.146322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:16.147071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:16.147494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:16.268854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:16.276615 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-291c27d7-5b78-484e-8c8d-104d56405508 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.141683 Oct 28 15:49:16.277176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 789/1536] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:16 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:16.689651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-30aac9b9-7947-498f-8b52-fd3430a39c49 req-bdee56cc-418d-4fc7-8edc-60594a667fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b88e85-cf04-4bb9-889d-bd9f2846e583", "name": "network-vif-plugged", "status": "completed", "tag": "467c0f2a-2891-4497-94f8-386341a69775"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:49:16.691240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:49:16.691240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:49:16.698661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-30aac9b9-7947-498f-8b52-fd3430a39c49 req-bdee56cc-418d-4fc7-8edc-60594a667fc9 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:16.699103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-30aac9b9-7947-498f-8b52-fd3430a39c49 req-bdee56cc-418d-4fc7-8edc-60594a667fc9 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:16.709701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-30aac9b9-7947-498f-8b52-fd3430a39c49 req-bdee56cc-418d-4fc7-8edc-60594a667fc9 service nova] Creating event network-vif-plugged:467c0f2a-2891-4497-94f8-386341a69775 for instance 64b88e85-cf04-4bb9-889d-bd9f2846e583 on hv-cinder-78364 Oct 28 15:49:16.714867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-30aac9b9-7947-498f-8b52-fd3430a39c49 req-bdee56cc-418d-4fc7-8edc-60594a667fc9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091127 Oct 28 15:49:16.715647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 748/1537] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:49:16.900954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:16.901481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:16.907176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:16.907616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:16.908373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:16.908821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:16.967023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:16.974861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d23a0ec4-14e4-44c7-b110-478dcd3c4a37 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077696 Oct 28 15:49:16.975414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 790/1538] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:17.293810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:17.294502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:17.300634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:17.301079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:17.301841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:17.302269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:17.420057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:17.427182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0cb657e2-4cd8-4047-a698-0156735c28e5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.138443 Oct 28 15:49:17.427733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 749/1539] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:17 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:17.991842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:17.992505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:17.999075 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:17.999518 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:18.000279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:18.000744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:18.064685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:18.072311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7eb25840-ceff-4bbf-bbb0-6ffbc8d109bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084144 Oct 28 15:49:18.072889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 791/1540] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:18.443918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:18.444573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:18.451494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:18.451940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:18.452734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:18.453167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:18.575622 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:18.582823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9aed742e-7d79-4545-b7fe-d1fd8bf5f265 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1318 microversion: 2.1 time: 0.142606 Oct 28 15:49:18.583380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 750/1541] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:18 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:19.088949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:19.089559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:19.096581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:19.097048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:19.098122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:19.098552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:19.157141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:19.164859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7b28d419-10a3-4c04-941c-5c1008848440 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080389 Oct 28 15:49:19.165443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 792/1542] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:19.599256 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:19.599857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:19.606043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:19.606484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:19.607238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:19.607662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:19.748572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:19.755757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ec3e7861-c03f-4859-aa04-2dbcc0799caf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1508 microversion: 2.1 time: 0.160188 Oct 28 15:49:19.756296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 751/1543] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:19 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:20.183614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:20.184226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:20.190470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:20.190909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:20.191670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:20.192098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:20.254005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:20.261552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-866d2b07-72a8-48fa-9c7b-7ace5be519c9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081578 Oct 28 15:49:20.262101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 793/1544] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:21.278637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:21.279135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:21.285347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:21.285873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:21.286619 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:21.287035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:21.346828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:21.354480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a9778ed9-82f5-4025-989a-ff311d873caa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080196 Oct 28 15:49:21.355034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 752/1545] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:22.371437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:22.372049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:22.378517 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:22.378952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:22.379708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:22.380133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:22.437912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:22.445796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-57055baf-96f0-40ab-bf40-799638a08b95 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078671 Oct 28 15:49:22.446364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 794/1546] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:23.462299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:23.462942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:23.469132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:23.469576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:23.470336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:23.470765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:23.529939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:23.537571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7b6bc56e-c24c-4b23-aa59-ad94dfdbcf01 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078960 Oct 28 15:49:23.538121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 753/1547] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:24.554502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:24.555109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:24.561527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:24.561966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:24.562729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:24.563160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:24.621543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:24.629356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7a39b90c-b161-4799-8b81-8c5b3fb4095e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078599 Oct 28 15:49:24.629918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 795/1548] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:25.646579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:25.647110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:25.653860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:25.654307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:25.655071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:25.655502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:25.719347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:25.727070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aed747c3-9db2-4a04-8ce6-486d2c21f004 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084196 Oct 28 15:49:25.727625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 754/1549] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:26.744869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:26.745563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:26.752047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:26.752523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:26.753296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:26.753727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:26.813861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:26.821734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-24c8f350-4bcf-4f65-b176-7b26592761e0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081249 Oct 28 15:49:26.822293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 796/1550] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:27.838363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:27.838999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:27.845234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:27.845672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:27.846430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:27.846882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:27.905332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:27.912916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9b707237-fefc-4dd3-8b32-98fbc8b1ce58 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078213 Oct 28 15:49:27.913470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 755/1551] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:28.929342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:28.929942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:28.936100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:28.936570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:28.937314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:28.937733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:28.995590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:29.003380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-19d042c4-6e77-496f-974b-ed4b0243c571 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077708 Oct 28 15:49:29.003932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 797/1552] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:30.020153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:30.020740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:30.027097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:30.031472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:30.031472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:30.031472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:30.086657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:30.094881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cf28a2a0-3c11-4baf-a22c-20117ad47acd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078340 Oct 28 15:49:30.095422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 756/1553] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:31.111938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:31.112500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:31.119282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:31.119735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:31.120783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:31.121201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:31.178175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:31.186337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-24393b1f-f6b0-42c1-93de-ac9a3fc5d02f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078149 Oct 28 15:49:31.186890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 798/1554] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:32.203153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:32.203787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:32.209657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:32.210103 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:32.210859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:32.211289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:32.274718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:32.282432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d8ae523b-62f3-4012-92ea-7eb876552286 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083083 Oct 28 15:49:32.282993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 757/1555] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:33.298914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:33.299551 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:33.306177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:33.306623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:33.307382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:33.307809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:33.364801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:33.373238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-76353ad1-a79c-4ed0-a0e1-bae527a7ec4d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077875 Oct 28 15:49:33.373809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 799/1556] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:34.390360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:34.390957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:34.397313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:34.397748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:34.398492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:34.398921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:34.467297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:34.474988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-73680a14-09c6-4e98-b88f-da7ea4db61e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.088237 Oct 28 15:49:34.475541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 758/1557] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:35.491286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:35.491896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:35.498397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:35.498837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:35.499592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:35.500039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:35.558038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:35.565712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-285b5d24-5768-43f4-9b3e-4399f30aada1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078069 Oct 28 15:49:35.566264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 800/1558] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:36.582333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:36.582991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:36.589178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:36.589650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:36.590411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:36.590836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:36.650427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:36.658094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1e3c091b-510d-425a-96e9-de23cd41660a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079422 Oct 28 15:49:36.660048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 759/1559] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:37.674748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:37.675356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:37.681658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:37.682102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:37.682861 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:37.683287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:37.741893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:37.749986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-19eb523a-f260-4ec0-8dd1-39ab5f927bca tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078924 Oct 28 15:49:37.750778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 801/1560] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:38.766786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:38.767381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:38.773586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:38.774675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:38.775422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:38.775840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:38.837450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:38.845080 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41d279c7-108d-440e-8508-6e5aec7950ae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081994 Oct 28 15:49:38.845623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 760/1561] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:39.861403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:39.862490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:39.868302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:39.868771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:39.869535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:39.869964 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:39.928971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:39.936609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-04dcde21-193e-4510-a3be-2584f45fcddb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078864 Oct 28 15:49:39.937161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 802/1562] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:39 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:40.953196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:40.953803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:40.960178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:40.963696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:40.963696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:40.963696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:41.021370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:41.029602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9375493e-f2e7-497a-b054-7acf3c5c452d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080231 Oct 28 15:49:41.030152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 761/1563] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:42.045906 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:42.046420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:42.052587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:42.053027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:42.053852 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:42.054228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:42.114375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:42.122726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0c9c32aa-1324-46fa-aad1-a4f3a3d1911f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080717 Oct 28 15:49:42.123567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 803/1564] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:43.140625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:43.141159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:43.147678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:43.148125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:43.148917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:43.149349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:43.207286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:43.215555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b039e9cf-f7b4-4283-aad9-5dc00ee95b0d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079935 Oct 28 15:49:43.216104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 762/1565] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:44.230925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:44.231523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:44.237739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:44.238170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:44.238914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:44.239334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:44.297734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:44.305334 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-05bdec26-eae9-4d66-b0ca-7f5886c8669a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078101 Oct 28 15:49:44.306478 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 804/1566] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:45.322270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:45.322908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:45.329157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:45.329597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:45.330414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:45.330801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:45.396288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:45.404057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-52d3a08e-22c7-4469-bffa-d2418a4def76 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.085434 Oct 28 15:49:45.404644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 763/1567] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:46.420414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:46.421026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:46.427203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:46.427640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:46.428412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:46.428901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:46.486383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:46.493922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2ef8c0c2-e88d-4b6e-9f8d-e996a91c8198 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077197 Oct 28 15:49:46.494960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 805/1568] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:47.511113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:47.511710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:47.517825 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:47.518261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:47.519001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:47.519423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:47.576776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:47.584300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-30b26717-2709-4ae8-a2e1-7ee3704c5441 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077016 Oct 28 15:49:47.584873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 764/1569] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:48.600625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:48.601254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:48.607393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:48.607836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:48.608632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:48.609060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:48.666929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:48.674467 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5512e8df-04d6-44b4-b5af-1c4ba4f14e54 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077611 Oct 28 15:49:48.675018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 806/1570] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:49.690835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:49.691439 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:49.698249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:49.698694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:49.699448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:49.699878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:49.759214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:49.768469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8a0fe8a5-f29b-4c46-9e2d-bd2e2eefc318 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080989 Oct 28 15:49:49.769146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 765/1571] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:50.786416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:50.787023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:50.793740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:50.794178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:50.794937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:50.795366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:50.858406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:50.866426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9c9f4093-0443-4057-a82c-6960af53260a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083729 Oct 28 15:49:50.866979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 807/1572] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:51.883089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:51.883685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:51.890007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:51.890441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:51.891185 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:51.891605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:51.954296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:51.962003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-53c13e45-2693-48d6-9116-5ea120b5c809 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082582 Oct 28 15:49:51.962550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 766/1573] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:51 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:52.979505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:52.980106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:52.986400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:52.986864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:52.987604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:52.988028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:53.046651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:53.054309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7567d67d-1ef0-424f-be86-15774fb14c72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078460 Oct 28 15:49:53.054859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 808/1574] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:54.071432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:54.071993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:54.078805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:54.079246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:54.080004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:54.080465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:54.138319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:54.145955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a233f345-db21-42f6-afe2-8df2dd8b1a42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078241 Oct 28 15:49:54.146618 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 767/1575] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:55.162601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:55.163125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:55.169574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:55.170012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:55.170755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:55.171171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:55.230968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:55.238479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-72987bde-27c2-42c5-a770-1a13f77910a8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079655 Oct 28 15:49:55.239025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 809/1576] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:56.254796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:56.255394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:56.261507 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:56.261944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:56.262691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:56.263111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:56.320492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:56.327986 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a6859dcd-e910-4eca-a602-2d1434476ecd tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.076834 Oct 28 15:49:56.328552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 768/1577] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:57.345511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:57.346112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:57.352336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:57.352805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:57.353563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:57.353991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:57.417829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:57.425728 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f276b922-eace-488c-bf04-9106c629973b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083849 Oct 28 15:49:57.426286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 810/1578] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:58.444261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:58.444901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:58.451114 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:58.451613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:58.452374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:58.452827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:58.514491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:58.521999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-db4a18dd-5f69-4f2b-918b-aefef0619fed tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081384 Oct 28 15:49:58.522553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 769/1579] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:49:59.538801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:49:59.539396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:49:59.545732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:59.546169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:59.546926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:49:59.547352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:49:59.605701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:49:59.613765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-63b8db01-b7a2-4bc5-9e9a-9103a061afe5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078633 Oct 28 15:49:59.614337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 811/1580] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:49:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:00.630453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:00.631064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:00.636985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:00.637432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:00.638195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:00.638628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:00.697994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:00.705677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f776cc97-e74d-42a9-8cb1-03b26a8af3ab tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078941 Oct 28 15:50:00.706234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 770/1581] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:01.722490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:01.723061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:01.729604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:01.730040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:01.730777 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:01.731202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:01.790135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:01.798231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-99a1876f-806f-4f5a-90e3-5c189faa0741 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079391 Oct 28 15:50:01.798783 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 812/1582] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:02.814893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:02.815493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:02.821920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:02.822363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:02.823117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:02.823541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:02.883341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:02.891108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fa9e0df6-3f2e-423c-b9a1-8b02170405df tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079876 Oct 28 15:50:02.891658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 771/1583] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:02 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:03.908033 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:03.908654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:03.914774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:03.915717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:03.916478 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:03.916896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:03.974613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:03.982696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-afd7469e-6c91-4f88-b8f3-7ef2baf344c2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078328 Oct 28 15:50:03.983242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 813/1584] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:04.999295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:04.999845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:05.006053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:05.006497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:05.007254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:05.007681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:05.069460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:05.077898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8eea367d-b039-4d29-a1a8-ee3985bfd596 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082588 Oct 28 15:50:05.078478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 772/1585] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:06.094429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:06.094943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:06.101181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:06.101621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:06.102385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:06.102849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:06.161234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:06.169387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-03bc3ed3-93ab-48b7-93d4-75b48c9aa409 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078683 Oct 28 15:50:06.169939 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 814/1586] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:07.185550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:07.186157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:07.192341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:07.192819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:07.193579 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:07.194010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:07.252262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:07.259989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-23a145ee-ce94-453e-b5ae-c0f258a6bca1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078161 Oct 28 15:50:07.260575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 773/1587] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:08.276400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:08.277029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:08.283234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:08.283705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:08.284493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:08.284926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:08.342897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:08.350515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9d3e199d-228e-4dbb-84f9-e695699804ef tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077802 Oct 28 15:50:08.351064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 815/1588] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:09.366901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:09.367489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:09.373870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:09.374304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:09.375051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:09.375499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:09.433416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:09.441004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a889cdf3-7e42-4744-8097-8800f7d0c65f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077833 Oct 28 15:50:09.441557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 774/1589] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:10.464845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:10.465400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:10.471960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:10.472433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:10.473223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:10.473656 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:10.537396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:10.545421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b692bab7-406a-4163-812e-a8798b971603 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084252 Oct 28 15:50:10.546002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 816/1590] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:11.562144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:11.562741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:11.569038 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:11.569421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:11.570179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:11.570602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:11.632871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:11.641081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4f6407c2-c428-4d7c-863d-be9b6c882463 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082636 Oct 28 15:50:11.641634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 775/1591] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:12.657884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:12.658481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:12.664645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:12.665078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:12.665820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:12.666249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:12.723684 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:12.731279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2a8dbf4f-6e28-4dad-85d9-ed95d85a2afe tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077058 Oct 28 15:50:12.731827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 817/1592] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:13.746947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:13.747805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:13.754112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:13.754542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:13.755288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:13.755708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:13.815218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:13.823278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f362fc67-af58-4638-9c30-015fb5b412e9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080022 Oct 28 15:50:13.823824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 776/1593] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:14.840085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:14.840719 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:14.846947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:14.847381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:14.848152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:14.848579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:14.907371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:14.916054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-969cf7ea-d819-4f32-a0f5-62185f4bec19 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079596 Oct 28 15:50:14.916648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 818/1594] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:14 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:15.932935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:15.933573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:15.939853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:15.940299 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:15.941102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:15.941533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:15.999838 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:16.007414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-49909e35-15b3-4495-b4b6-7a4dbd627431 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078774 Oct 28 15:50:16.007963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 777/1595] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:17.024324 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:17.025379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:17.031618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:17.032056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:17.032841 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:17.033273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:17.091055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:17.098663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6ff69bcc-f39e-441f-b600-4dfa7e856185 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078145 Oct 28 15:50:17.099219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 819/1596] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:18.114906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:18.115488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:18.122597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:18.123071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:18.123841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:18.124307 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:18.186931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:18.194659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-82f6ecb9-1d92-4f2f-b94f-fbf3dcc1226b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083530 Oct 28 15:50:18.195202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 778/1597] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:19.210932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:19.211567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:19.218447 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:19.218888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:19.219639 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:19.220062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:19.278698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:19.286192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f1e2dc2b-18a4-42e0-91c4-ee5ba64f56c5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078973 Oct 28 15:50:19.286734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 820/1598] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:20.302742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:20.303354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:20.309717 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:20.310161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:20.310922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:20.311355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:20.369137 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:20.377018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-be3d4fc2-049b-4bf4-83bf-6942815b41ac tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077923 Oct 28 15:50:20.377574 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 779/1599] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:21.393889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:21.394499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:21.401068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:21.401508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:21.402265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:21.402695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:21.468536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:21.476199 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b4dfe557-cfbe-4df6-b07d-81d48d0b8086 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.086065 Oct 28 15:50:21.476791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 821/1600] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:22.493349 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:22.493948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:22.500416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:22.500864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:22.501623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:22.502050 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:22.559762 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:22.567402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ef7dadb2-5610-4a50-8d71-88758f944eaf tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077792 Oct 28 15:50:22.567958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 780/1601] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:23.583807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:23.584309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:23.590606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:23.591045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:23.591797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:23.592217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:23.649812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:23.657430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2fb61c6d-a8aa-4c54-bbc6-7be80ea5382f tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077341 Oct 28 15:50:23.657980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 822/1602] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:24.674551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:24.675160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:24.681428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:24.681871 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:24.682628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:24.683057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:24.744823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:24.752791 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a2308085-211b-4485-b818-5e5e4059cef3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081889 Oct 28 15:50:24.753339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 781/1603] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:25.768956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:25.769563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:25.776343 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:25.776805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:25.777558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:25.777980 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:25.837903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:25.845555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7a9b549d-f97e-4a5b-95ac-c51f78f1e7d3 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080263 Oct 28 15:50:25.846117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 823/1604] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:26.862278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:26.862888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:26.869417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:26.869856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:26.870620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:26.871046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:26.931925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:26.939492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7297f460-b56a-4153-9ca6-0bd0992ced90 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080953 Oct 28 15:50:26.940048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 782/1605] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:26 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:50:27.956373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:27.956986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:27.963810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:27.964243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:27.965018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:27.965438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:28.022976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:28.032986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-042697d8-bb14-4f3b-83e0-59192611463d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080244 Oct 28 15:50:28.033558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 824/1606] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:29.049699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:29.050224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:29.056677 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:29.057127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:29.057896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:29.058360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:29.118396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:29.126266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a01d2315-a11d-4bc0-a102-6a1b21ab2b94 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080447 Oct 28 15:50:29.126822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 783/1607] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:30.142810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:30.143323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:30.149578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:30.150082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:30.150840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:30.151265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:30.209408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:30.217238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f21cc3f2-82e5-42eb-bda4-df2c665fb972 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078141 Oct 28 15:50:30.217802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 825/1608] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:31.233854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:31.234456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:31.240271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:31.240742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:31.241537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:31.241970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:31.354040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:31.361819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1feb8456-a576-46a8-bd69-191f23b73d7d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.131794 Oct 28 15:50:31.362382 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 784/1609] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:32.378919 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:32.379549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:32.385426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:32.385864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:32.386620 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:32.387047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:32.493734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:32.502309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e49fff8f-ec0b-4865-8fa5-0bd6bdfa1f3e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.127185 Oct 28 15:50:32.502863 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 826/1610] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:33.518705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:33.519298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:33.525484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:33.525918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:33.527168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:33.527609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:33.584828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:33.592957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a8497200-e671-48b8-bf6c-acbbbe4038f0 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077873 Oct 28 15:50:33.593511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 785/1611] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:34.609282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:34.609879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:34.615965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:34.616419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:34.617158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:34.617577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:34.675677 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:34.683257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b5b54d35-d396-4adf-bace-40ce472e5770 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077648 Oct 28 15:50:34.683803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 827/1612] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:50:35.699742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:35.700412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:35.706578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:35.707022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:35.707783 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:35.708215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:35.767359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:35.775006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ae2b5c25-1103-4903-b809-1683c759e4e8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078990 Oct 28 15:50:35.775559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 786/1613] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:35 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:36.792852 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:36.793481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:36.799590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:36.800364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:36.801192 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:36.801618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:36.860365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:36.868150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8c2c711a-7d83-4d82-b2f0-ec6b959e34fa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079077 Oct 28 15:50:36.868885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 828/1614] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:36 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:37.886358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:37.886999 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:37.893183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:37.893627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:37.894390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:37.894818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:37.956559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:37.964844 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-80a894b6-b5b3-4318-a3fa-fef6b6570bf6 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082632 Oct 28 15:50:37.965396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 787/1615] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:37 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:38.981127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:38.981723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:38.987853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:38.988286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:38.989061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:38.989484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:39.047543 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:39.055143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e7ba4b7d-f852-4e9b-af33-dfdadc36048a tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077617 Oct 28 15:50:39.055695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 829/1616] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:38 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:40.072062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:40.072611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:40.078810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:40.079254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:40.080009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:40.080461 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:40.140720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:40.148297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7fd2ba89-9520-4ee7-a56a-73a147b544b1 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080039 Oct 28 15:50:40.148872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 788/1617] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:40 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:41.164022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:41.164582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:41.171459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:41.171900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:41.172694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:41.173121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:41.232598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:41.240180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-685b2fcf-494a-4415-834d-cb8489da2479 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079964 Oct 28 15:50:41.240768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 830/1618] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:41 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:42.257198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:42.257803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:42.264588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:42.265033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:42.265801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:42.266235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:42.324477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:42.331958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-404fe03f-3a00-4659-ab00-7cc2b69aff42 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078687 Oct 28 15:50:42.332666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 789/1619] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:42 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:43.348884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:43.349511 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:43.356301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:43.356756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:43.357502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:43.357922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:43.415047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:43.423264 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3b5aefc4-370d-42a9-8f94-981a576a8b06 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078038 Oct 28 15:50:43.423812 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 831/1620] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:43 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:44.439467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:44.440074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:44.446295 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:44.446739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:44.447497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:44.447928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:44.510441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:44.518111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0f408656-12fe-44ab-8dce-fe2cd2cc81bb tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082329 Oct 28 15:50:44.518668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 790/1621] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:44 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:45.534495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:45.535101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:45.541247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:45.541691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:45.542439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:45.542860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:45.600857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:45.608413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-834f01af-de50-472c-aa31-b31622d0f931 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077599 Oct 28 15:50:45.608982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 832/1622] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:45 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:46.625060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:46.625669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:46.631941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:46.632378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:46.633158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:46.633586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:46.691676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:46.699857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e47d6172-ffaf-4b46-bd61-2e790ca26548 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078746 Oct 28 15:50:46.700431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 791/1623] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:46 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:47.716644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:47.717247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:47.723386 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:47.723817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:47.724588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:47.725006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:47.783885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:47.792130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fed7f145-20bf-4ac0-9432-1d54eeb8c665 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078993 Oct 28 15:50:47.792723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 833/1624] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:47 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:48.809707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:48.810308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:48.816639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:48.817082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:48.817841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:48.818274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:48.876758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:48.884504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6ec78e58-d39e-4c70-b362-60a34032cc17 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079053 Oct 28 15:50:48.885061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 792/1625] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:48 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:49.901600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:49.902269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:49.909220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:49.910212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:49.910380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:49.910797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:49.969506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:49.977158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9f70e2c1-21af-4be6-8f05-35d69be51940 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079728 Oct 28 15:50:49.977727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 834/1626] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:49 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:50:50.993440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:50.994630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:51.001907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:51.002341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:51.003127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:51.003552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:51.066633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:51.074463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9caf0dec-f064-4e23-b9c2-d14abf6baa14 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084756 Oct 28 15:50:51.075010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 793/1627] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:50 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:52.095321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:52.095837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:52.102035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:52.102472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:52.103232 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:52.103655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:52.163498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:52.171330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4366c5bb-d39a-4c75-b463-3d813e5c9f64 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.084567 Oct 28 15:50:52.171891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 835/1628] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:52 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:53.187816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:53.188454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:53.194687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:53.195125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:53.195890 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:53.196315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:53.254946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:53.262576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ebb9d5ba-b823-4ea3-8fed-c6d4a46009c4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078411 Oct 28 15:50:53.263129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 794/1629] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:53 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:54.278802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:54.279410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:54.285618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:54.286057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:54.286811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:54.287236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:54.346927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:54.355056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0c05e4da-8ee6-4661-a26f-039878a4a66e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079416 Oct 28 15:50:54.355616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 836/1630] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:54 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:55.372173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:55.372808 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:55.378973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:55.379412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:55.380170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:55.380628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:55.438336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:55.445954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-10a2f857-b4fc-4e83-a4bd-f87887cfceae tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078277 Oct 28 15:50:55.446507 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 795/1631] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:55 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:56.463283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:56.464129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:56.470487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:56.470916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:56.471672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:56.472093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:56.529519 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:56.536981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fb4dc4c3-68a9-4209-a948-a5b367ef44b2 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077548 Oct 28 15:50:56.537530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 837/1632] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:56 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:57.553885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:57.554508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:57.561279 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:57.561719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:57.562474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:57.562898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:57.626444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:57.634132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d1205ebc-09dc-44ba-93c4-a19addf5669b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083945 Oct 28 15:50:57.634695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 796/1633] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:57 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:58.650796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:58.651997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:58.658220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:58.658665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:58.659422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:58.659864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:58.717790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:58.725373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-78964133-4556-4ced-8f1f-59a624b02a72 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078309 Oct 28 15:50:58.725929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 838/1634] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:58 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:50:59.744113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:50:59.745365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:50:59.751919 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:59.752362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:59.753155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:50:59.753585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:50:59.811788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:50:59.819389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b6a1e41e-fa06-45a9-bc38-37e1f877795b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078964 Oct 28 15:50:59.819938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 797/1635] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:50:59 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:00.349225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:51:00.349764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:51:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:51:00.714161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:51:00.714342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:51:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:51:00.836214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:00.836848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:00.843748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:00.844191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:00.844976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:00.845405 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:00.903955 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:00.911697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd9802ec-c91e-456c-b0da-6baa3ee95506 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079101 Oct 28 15:51:00.912254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 839/1636] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:00 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:01.928174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:01.928807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:01.934763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:01.935205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:01.935964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:01.936438 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:01.994423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:02.002252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9b0e04ae-ab93-45fd-9fb0-8d731f79bb2d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077734 Oct 28 15:51:02.003055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 798/1637] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:01 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:03.018885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:03.019406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:03.025263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:03.025703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:03.027008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:03.027430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:03.085104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:03.093209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a951762f-788d-4196-94aa-6ea9b3b7e56c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078187 Oct 28 15:51:03.093764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 840/1638] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:03 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:04.110302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:04.110879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:04.117395 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:04.117836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:04.118593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:04.119023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:04.180861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:04.188508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3828da44-00f9-40fe-bd8c-a23ba63fe2a4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081916 Oct 28 15:51:04.189056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 799/1639] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:04 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:05.205142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:05.205749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:05.211926 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:05.212368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:05.213150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:05.213581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:05.272345 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:05.280030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f0596e6-753b-49f0-a48d-101840941d46 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078549 Oct 28 15:51:05.280616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 841/1640] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:05 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:06.296434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:06.297046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:06.303320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:06.303763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:06.304555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:06.304987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:06.363017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:06.370664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-81ba3e1f-71af-494b-ac34-3b6fe3388cba tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077936 Oct 28 15:51:06.371482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 800/1641] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:06 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:07.388160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:07.388820 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:07.395078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:07.395523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:07.396283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:07.396744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:07.459364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:07.467717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-98e4fa02-a866-403f-b6d4-2147547c288d tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.083316 Oct 28 15:51:07.468272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 842/1642] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:07 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:08.484664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:08.485249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:08.491372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:08.491807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:08.492594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:08.493004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:08.551001 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:08.558820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f1a0d6d9-1544-465e-8222-d668324d8e65 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077873 Oct 28 15:51:08.559368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 801/1643] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:08 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:09.575687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:09.576285 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:09.582504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:09.582942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:09.583699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:09.584125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:09.643828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:09.651403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9e597a69-e7b6-4cc4-bd2b-11cee9186d3b tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079982 Oct 28 15:51:09.651952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 843/1644] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:09 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:10.667807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:10.668484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:10.674594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:10.675036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:10.675795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:10.676237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:10.737993 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:10.746054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-85ef8f31-0939-4a13-af66-32d63cd4baa9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081641 Oct 28 15:51:10.746644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 802/1645] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:10 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:11.762349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:11.762958 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:11.769241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:11.769680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:11.770440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:11.770865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:11.829821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:11.839569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e5b431ae-4eea-4360-a1a3-d822b6ce1497 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080850 Oct 28 15:51:11.840130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 844/1646] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:11 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:12.856554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:12.857159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:12.863368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:12.863892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:12.864719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:12.865153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:12.925573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:12.933830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8377cc82-c5bb-4e5f-b3fe-a86ace62f7d8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081440 Oct 28 15:51:12.934376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 803/1647] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:12 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:13.950085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:13.950693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:13.956918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:13.957360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:13.958179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:13.958611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:14.017236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:14.024842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2b5322ee-0ffe-4e8e-bc71-b3ca22712de4 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079008 Oct 28 15:51:14.025392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 845/1648] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:13 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:15.041003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:15.041514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:15.047634 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:15.048077 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:15.048857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:15.049282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:15.107336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:15.114897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3b2381d9-7f7f-4669-9d3b-feda0813e049 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077628 Oct 28 15:51:15.115447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 804/1649] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:15 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:16.131673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:16.132183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:16.138552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:16.138991 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:16.139744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:16.140172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:16.197814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:16.205370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c866d666-3418-48f4-aea7-019c08c29e80 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077473 Oct 28 15:51:16.205928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 846/1650] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:16 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:17.221971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:17.222566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:17.229305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:17.229738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:17.230487 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:17.230908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:17.293536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:17.301215 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a4a85e33-d944-4aa4-8dde-c06ad3def855 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.082862 Oct 28 15:51:17.301766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 805/1651] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:17 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:51:18.317104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:18.317708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:18.323998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:18.327051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:18.327051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:18.327051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:18.386055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:18.393826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-faf2833a-26e2-4219-913c-c8f7fc01d6c8 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080349 Oct 28 15:51:18.394318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 847/1652] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:18 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:19.409703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:19.410305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:19.416676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:19.417119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:19.417879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:19.418310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:19.478442 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:19.486142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-787d7450-72c7-4e52-a1e4-b2b3862c33e5 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080132 Oct 28 15:51:19.486691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 806/1653] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:19 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:20.503225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:20.503817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:20.509937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:20.510878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:20.511619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:20.512037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:20.569586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:20.577614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b7fcea74-54a6-4b6b-b050-6db6c0f85226 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078042 Oct 28 15:51:20.578156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 848/1654] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:20 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:21.593252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:21.593858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:21.600036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:21.600510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:21.601271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:21.601693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:21.660270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:21.668254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fc4aab34-3b8d-4627-8ca2-ee4e2b1325d9 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078630 Oct 28 15:51:21.668840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 807/1655] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:21 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:51:22.684657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:22.685255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:22.691443 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:22.691880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:22.692661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:22.693085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:22.752087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:22.759857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-457216c7-124d-49a8-9ca7-8be52b4884aa tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078898 Oct 28 15:51:22.760935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 849/1656] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:22 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:23.409037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:51:23.409201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:51:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:51:23.776836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:23.777448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:23.783693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:23.784135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:23.784926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:23.785356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:23.847059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:23.855022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-47e47817-58da-40a0-9a43-a42d20a89491 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081830 Oct 28 15:51:23.855576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 808/1657] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:23 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:24.871627 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:24.874037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:24.879147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:24.879579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:24.880318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:24.880760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:24.940850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:24.948546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-108f6939-d428-4ae0-b443-be299a5d3d15 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.080817 Oct 28 15:51:24.949095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 850/1658] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:24 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:25.965870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:25.966468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:25.973027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:25.973468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:25.974222 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:25.974645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:26.035045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:26.043370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f86c4eb4-91b6-4bd4-9bff-ea842698d58c tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081650 Oct 28 15:51:26.043924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 809/1659] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:25 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:27.060623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:27.061138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:27.067284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:27.067726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:27.068500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:27.068924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:27.129815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:27.137316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e4d4a516-1acf-48ec-8029-7ac56408bd26 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081283 Oct 28 15:51:27.137859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 851/1660] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:27 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:28.153642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:28.154218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:28.160294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:28.160766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:28.161520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:28.162075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:28.220411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:28.228502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-58aac2a5-56b1-49c5-bfa5-465ec94b5849 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.078447 Oct 28 15:51:28.229100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 810/1661] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:28 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:29.246968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:29.247566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:29.253726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:29.254155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:29.254894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:29.255313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:29.313079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:29.320581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ccb57c69-6e4c-45a1-ab77-8ac5553c3751 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077487 Oct 28 15:51:29.321133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 852/1662] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:29 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:30.337327 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:30.337935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:30.343952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:30.344417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:30.345187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:30.345617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:30.407325 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:30.415124 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-741d9409-cc99-4acf-b262-0bd3504f0ced tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081411 Oct 28 15:51:30.415754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 811/1663] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:30 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:31.432160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:31.432791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:31.439189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:31.439633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:31.440410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:31.440840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:31.498271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:31.505835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9498fc63-4b3c-4101-a12c-b98170c40842 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.077318 Oct 28 15:51:31.506393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 853/1664] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:31 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:32.522739 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:32.523326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:32.530443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:32.530880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:32.531888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:32.532331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:32.602987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:32.610639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-286de68c-0f0a-4eb6-b36b-76426f2e0345 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.091672 Oct 28 15:51:32.611184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 812/1665] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:32 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:33.627753 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:33.628290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:33.634686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:33.635128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:33.635886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:33.636922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:33.697118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:33.705317 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f40b4c32-2534-4597-9887-efe04f2f9c10 tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.081270 Oct 28 15:51:33.705873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 854/1666] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:33 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:34.720904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:34.721504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] [instance: 13279aaf-dc79-4544-b2dc-8c5099d7b405] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:34.727648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:34.728083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:34.728863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:34.729289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:34.788750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae40a5606044eeb8a8694d05569f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb43abf174b43e2960be3d166b34f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:34.796886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f6cad196-868f-4d2d-8190-7961c1438d2e tempest-ServerRescueNegativeTestJSON-419197950 tempest-ServerRescueNegativeTestJSON-419197950-project] 10.222.0.86 "GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405" status: 200 len: 1352 microversion: 2.1 time: 0.079582 Oct 28 15:51:34.797441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 813/1667] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:34 2021] GET /compute/v2.1/servers/13279aaf-dc79-4544-b2dc-8c5099d7b405 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:36.112151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:51:36.112695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:51:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:51:44.822130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: .version_select at 0x7fdc180f6af0>, body: {"keypair": {"name": "tempest-keypair-54929674"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:51:44.845652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:51:44.849742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:51:45.182733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:51:45.186329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:51:45.198564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f47ca584-ea3e-482d-aafc-6962d0ed29d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.491659 Oct 28 15:51:45.199151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 855/1668] 10.222.0.86 () {60 vars in 1157 bytes} [Thu Oct 28 15:51:44 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:47.408007 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1944008178", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c8010e3-a678-4927-bade-213e1fcc742d"}], "security_groups": [{"name": "tempest-securitygroup--907081371"}], "key_name": "tempest-keypair-54929674", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:51:47.516217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] validate_networks() for [('9c8010e3-a678-4927-bade-213e1fcc742d', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:51:47.918397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:51:47.918819 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:51:47.919292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:51:47.920323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:51:47.920781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:51:47.934036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:47.934474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:47.935297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:47.935765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:47.953058 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:51:47.957471 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:51:47.969096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:51:47.971333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:51:48.105326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ae4bf6c7-b0c2-45d0-b528-5ce295e93438 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.701768 Oct 28 15:51:48.105980 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 814/1669] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:51:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:51:48.122179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-244daf30-8cba-486c-be77-3a13b81a0796 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:48.122794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-244daf30-8cba-486c-be77-3a13b81a0796 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:48.183426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-244daf30-8cba-486c-be77-3a13b81a0796 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:48.190569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-244daf30-8cba-486c-be77-3a13b81a0796 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1236 microversion: 2.1 time: 0.078126 Oct 28 15:51:48.191157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 856/1670] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:48 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:51:49.208180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:49.208827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:49.214928 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:49.215367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:49.216158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:49.217142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:49.275131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:49.283144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-93998e8b-41d1-4c5b-b5df-a6d9cf13f0d9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1240 microversion: 2.1 time: 0.079418 Oct 28 15:51:49.283708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 815/1671] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:49 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:50.300635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:50.301853 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:50.309938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:50.310374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:50.311788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:50.312209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:50.370007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:50.378015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8ad3a0e8-d4a8-4d9b-8c39-a53325d4ddb1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1306 microversion: 2.1 time: 0.081747 Oct 28 15:51:50.378626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 857/1672] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:50 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1306 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:51.403637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:51.403637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:51.403637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:51.403637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:51.405728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:51.406244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:51.533482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:51.540680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e5509f82-7425-4268-8fc4-7e60670be440 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.149513 Oct 28 15:51:51.541273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 816/1673] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:51 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:51.640145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-16ade8b2-f4a4-48c6-9782-b79decd19c4c req-f449b5bc-e4c4-49ab-be4e-db69c0da5719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882e73f1-1371-4b7f-a683-76e5c9c6a07b", "tag": "eb03a5c0-29fe-4a09-a40a-75914262a0e2"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:51:51.641882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:51:51.641882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:51:51.649740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-16ade8b2-f4a4-48c6-9782-b79decd19c4c req-f449b5bc-e4c4-49ab-be4e-db69c0da5719 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:51.655979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-16ade8b2-f4a4-48c6-9782-b79decd19c4c req-f449b5bc-e4c4-49ab-be4e-db69c0da5719 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:51.672938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-16ade8b2-f4a4-48c6-9782-b79decd19c4c req-f449b5bc-e4c4-49ab-be4e-db69c0da5719 service nova] Creating event network-changed:eb03a5c0-29fe-4a09-a40a-75914262a0e2 for instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b on hv-cinder-78364 Oct 28 15:51:51.680224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-16ade8b2-f4a4-48c6-9782-b79decd19c4c req-f449b5bc-e4c4-49ab-be4e-db69c0da5719 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043475 Oct 28 15:51:51.680914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 858/1674] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:51:52.558246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:52.558889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:52.565616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:52.566049 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:52.566796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:52.567218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:52.687626 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:52.695198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7ad9ebb9-5405-4552-9d47-a0604a519fd1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.140683 Oct 28 15:51:52.695752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 817/1675] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:52 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:53.713268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:53.713965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:53.720469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:53.720915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:53.721676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:53.722101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:53.839270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:53.846927 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e11f4ee-2172-4d2d-aa85-2494255944d5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.138141 Oct 28 15:51:53.847479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 859/1676] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:53 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:54.863293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:54.863889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:54.884150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:54.884150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:54.884150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:54.884150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:54.988852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:54.996059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1db4b974-c96b-4c66-8256-41323f1cd4e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.136356 Oct 28 15:51:54.996584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 818/1677] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:54 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:56.012808 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:56.013362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:56.019577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:56.020015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:56.020796 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:56.021223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:56.141255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:56.148323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7097296c-b409-477c-97fc-f29284372fc8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.139252 Oct 28 15:51:56.148898 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 860/1678] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:56 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:57.165443 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:57.165950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:57.172184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:57.172659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:57.173419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:57.173848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:57.297594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:57.304925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3ca8f5dc-addf-4c72-a557-0c6b677df4b4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.143190 Oct 28 15:51:57.305479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 819/1679] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:57 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:57.446135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-cbf8a7c4-ebb2-4772-a076-351603fd75a3 req-decbade6-3871-4b6e-b13c-d5a17eb73306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882e73f1-1371-4b7f-a683-76e5c9c6a07b", "name": "network-vif-plugged", "status": "completed", "tag": "eb03a5c0-29fe-4a09-a40a-75914262a0e2"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:51:57.447659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:51:57.447659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:51:57.455428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-cbf8a7c4-ebb2-4772-a076-351603fd75a3 req-decbade6-3871-4b6e-b13c-d5a17eb73306 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:57.455865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-cbf8a7c4-ebb2-4772-a076-351603fd75a3 req-decbade6-3871-4b6e-b13c-d5a17eb73306 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:57.466363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-cbf8a7c4-ebb2-4772-a076-351603fd75a3 req-decbade6-3871-4b6e-b13c-d5a17eb73306 service nova] Creating event network-vif-plugged:eb03a5c0-29fe-4a09-a40a-75914262a0e2 for instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b on hv-cinder-78364 Oct 28 15:51:57.471387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-cbf8a7c4-ebb2-4772-a076-351603fd75a3 req-decbade6-3871-4b6e-b13c-d5a17eb73306 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028855 Oct 28 15:51:57.472957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 861/1680] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:51:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:51:58.321990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:58.322592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:58.328865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:58.329308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:58.330064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:58.330492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:58.447597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:58.455335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1e57c9c9-728e-4096-862e-78490aa9cac9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1361 microversion: 2.1 time: 0.136976 Oct 28 15:51:58.455888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 820/1681] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:58 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:59.472346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:59.473062 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:59.479010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:59.479446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:59.480194 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:59.480642 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:59.601444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:51:59.608591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a72062ba-b80a-4d1e-800c-3cd4637bbf8d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1548 microversion: 2.1 time: 0.140687 Oct 28 15:51:59.609139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 862/1682] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:51:59 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1548 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:51:59.624816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:51:59.625547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:51:59.631658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:59.632032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:59.632801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:51:59.633225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:51:59.713821 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b20a696a-01c0-4f36-8cde-bd24640b7f5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092517 Oct 28 15:51:59.714420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 821/1683] 10.222.0.86 () {58 vars in 1274 bytes} [Thu Oct 28 15:51:59 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:52:00.924098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:00.925038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:00.932582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:00.933028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:00.934186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:00.935044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:00.990067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-8f0d91de-a0ec-42c9-90c1-336ad5afda93 req-41a30a55-4630-4653-b063-a0038f79d46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882e73f1-1371-4b7f-a683-76e5c9c6a07b", "tag": "eb03a5c0-29fe-4a09-a40a-75914262a0e2"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:00.991608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:52:00.991608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:52:00.998398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8f0d91de-a0ec-42c9-90c1-336ad5afda93 req-41a30a55-4630-4653-b063-a0038f79d46f service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:00.998762 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8f0d91de-a0ec-42c9-90c1-336ad5afda93 req-41a30a55-4630-4653-b063-a0038f79d46f service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:00.999330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ec53cd66-6eef-412b-a022-299accead68e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.079417 Oct 28 15:52:01.000173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 863/1684] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:00 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:01.010469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-8f0d91de-a0ec-42c9-90c1-336ad5afda93 req-41a30a55-4630-4653-b063-a0038f79d46f service nova] Creating event network-changed:eb03a5c0-29fe-4a09-a40a-75914262a0e2 for instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b on hv-cinder-78364 Oct 28 15:52:01.015734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-8f0d91de-a0ec-42c9-90c1-336ad5afda93 req-41a30a55-4630-4653-b063-a0038f79d46f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093675 Oct 28 15:52:01.019031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 822/1685] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:52:02.011632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:02.012569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:02.019311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:02.019746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:02.020616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:02.021041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:02.079752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-aeec9d1d-d72d-46db-b21d-a7a752a55f6e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.072034 Oct 28 15:52:02.080938 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 864/1686] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:02 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:03.090834 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:03.091773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:03.098522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:03.098955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:03.099703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:03.100125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:03.158612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0fef389d-5bcb-4f5c-80b0-ea16019e344b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.072161 Oct 28 15:52:03.159196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 823/1687] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:03 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:04.169817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:04.170799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:04.177586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:04.178018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:04.178757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:04.179173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:04.239533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2a9fa0f9-b8de-4644-af64-c2334dceb315 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.073612 Oct 28 15:52:04.240107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 865/1688] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:04 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 15:52:05.250778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:05.252031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:05.258851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:05.259296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:05.260064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:05.260532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:05.323985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ef708cb5-8368-469f-9a08-1c2c42c4f136 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.077079 Oct 28 15:52:05.324636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 824/1689] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:05 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:06.335182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:06.336182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:06.342992 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:06.343439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:06.344201 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:06.345163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:06.411223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5faebdf8-27a6-41e4-b5cd-276cd69e8993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.079858 Oct 28 15:52:06.411877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 866/1690] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:06 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:07.422047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:07.423670 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:07.430397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:07.430839 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:07.431591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:07.432018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:07.492045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-70ec786c-dbef-4ed6-a8e9-7988b4d69a82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.073969 Oct 28 15:52:07.492655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 825/1691] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:07 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:08.504018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:08.505073 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:08.511794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:08.512236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:08.513026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:08.513453 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:08.598430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-08807d16-3558-41c6-a7d8-cbae83b0dc59 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.099196 Oct 28 15:52:08.599686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 867/1692] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:08 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:09.609559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:09.610588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:09.617389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:09.617833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:09.618595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:09.619025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:09.682131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8f915fba-7fb0-49b0-8b0c-5e5d706da99b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.076525 Oct 28 15:52:09.682770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 826/1693] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:09 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:10.692977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:10.693997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:10.700810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:10.701254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:10.702008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:10.702435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:10.759833 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bdb06113-07fb-4db9-9bcf-129fcab23eab tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 14 microversion: 2.1 time: 0.071370 Oct 28 15:52:10.760495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 868/1694] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:10 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:52:11.771851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:11.772867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:11.779700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:11.780195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:11.780981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:11.781412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:11.855893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-abb332a6-0f23-4cd7-8b03-774f26b25915 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 6139 microversion: 2.1 time: 0.088521 Oct 28 15:52:11.856457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 827/1695] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:11 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 6139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:52:12.868690 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:12.876444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:12.876557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:12.877219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:12.877983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:12.878408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:12.947172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-eb1faa47-4c5a-4885-b3ac-f5e12424e121 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 15025 microversion: 2.1 time: 0.082479 Oct 28 15:52:12.947788 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 869/1696] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:12 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 15025 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:13.959517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:13.960525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:13.967309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:13.967751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:13.968541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:13.968968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:14.044478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb38437d-8107-488e-99d0-a5f08fcb8473 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 18561 microversion: 2.1 time: 0.089382 Oct 28 15:52:14.045086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 828/1697] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:13 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 18561 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:15.055999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:15.056947 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:15.063856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:15.064298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:15.065090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:15.065570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:15.137257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5d0812cc-2407-4ec4-9dac-a92d88ae95a4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 19342 microversion: 2.1 time: 0.085360 Oct 28 15:52:15.137886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 870/1698] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:15 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 19342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:16.148326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:16.149259 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:16.156020 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:16.156488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:16.157246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:16.157691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:16.230394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e9ff6d3d-0f4f-4dc3-a120-8aef607c4d0d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 22070 microversion: 2.1 time: 0.086042 Oct 28 15:52:16.231354 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 829/1699] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:16 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 22070 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:17.243644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:17.244771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:17.252141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:17.252876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:17.253644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:17.254072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:17.328137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f3219d96-91d2-46ac-8c13-0eabf6cf3ca2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 23235 microversion: 2.1 time: 0.090177 Oct 28 15:52:17.328954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 871/1700] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:17 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 23235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:18.340569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:18.341586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:18.348437 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:18.348886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:18.349648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:18.350081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:18.426451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0262c44f-0540-46ce-a39b-c1f9ae920bad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 24638 microversion: 2.1 time: 0.089742 Oct 28 15:52:18.427078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 830/1701] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:18 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 24638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:19.438422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:19.439410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:19.446189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:19.446621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:19.447360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:19.447780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:19.528468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-69564814-99bf-4cbb-b192-2480f731e8a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 26183 microversion: 2.1 time: 0.093895 Oct 28 15:52:19.529090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 872/1702] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:19 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 26183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:20.541066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:20.542054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:20.548803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:20.549244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:20.549997 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:20.550420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:20.629969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-228aa5b1-0d77-4b04-836c-586a668738f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 27254 microversion: 2.1 time: 0.092778 Oct 28 15:52:20.630613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 831/1703] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:20 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 27254 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:21.642091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:21.643018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:21.649800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:21.650237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:21.650997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:21.651425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:21.728284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ac7588d9-81d1-48c8-9765-a24d40ad9c1c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 27765 microversion: 2.1 time: 0.090082 Oct 28 15:52:21.729250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 873/1704] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:21 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 27765 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:22.740263 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:22.741277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:22.747964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:22.748412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:22.749177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:22.749603 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:22.825855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c1dc85fe-3df9-458f-a711-ac1e48b736ef tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28071 microversion: 2.1 time: 0.089509 Oct 28 15:52:22.826478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 832/1705] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:22 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28071 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:23.838899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:23.839899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:23.846747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:23.847193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:23.847952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:23.848407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:23.923748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-490151ad-6c92-49c9-8b2a-e368312dfb4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.088687 Oct 28 15:52:23.924414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 874/1706] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:23 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:24.936119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:24.937176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:24.944004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:24.944477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:24.945238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:24.945671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:25.014897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-16c8a27b-a911-4f16-aba3-0bed3e508fc5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.082570 Oct 28 15:52:25.015435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 833/1707] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:24 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:26.026880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:26.027790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:26.034559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:26.035001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:26.035755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:26.036185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:26.098320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e50d1c84-a358-469d-a696-ce0c7505f812 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.075414 Oct 28 15:52:26.099432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 875/1708] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:26 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:27.110801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:27.111696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:27.118435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:27.118870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:27.119614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:27.120040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:27.190306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2ae5172c-e451-45d7-b4df-f84626d2bf65 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.083487 Oct 28 15:52:27.191166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 834/1709] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:27 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:28.202377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:28.203360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:28.210202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:28.210651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:28.211410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:28.211837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:28.276403 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6c150831-e1a3-4922-96fb-bdbe223c97cb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.077932 Oct 28 15:52:28.277277 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 876/1710] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:28 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:29.288330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:29.289386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:29.296011 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:29.296474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:29.297219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:29.297640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:29.364194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bb42e356-20cc-4536-8088-30b0728b6349 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.079808 Oct 28 15:52:29.364877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 835/1711] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:29 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:30.376970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:30.378180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:30.385922 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:30.386360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:30.387112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:30.387534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:30.452022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-69b0ee2c-84ca-4e98-a2a9-8c9dfabc63c7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.079057 Oct 28 15:52:30.452884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 877/1712] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:30 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:31.463591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:31.464658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:31.471446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:31.471885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:31.472679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:31.473109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:31.534539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0b31a87d-346a-4734-b7ac-67464f69defe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.074851 Oct 28 15:52:31.535180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 836/1713] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:31 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:32.546526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:32.547541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:32.554332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:32.554778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:32.555536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:32.555965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:32.613381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a57ab567-43ef-4e9c-b385-bcee0cdbf115 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.070824 Oct 28 15:52:32.614265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 878/1714] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:32 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:33.625321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:33.626318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:33.633399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:33.633845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:33.634604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:33.635035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:33.698639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f8137a5a-df3a-4907-9725-3cf3bc6d3bde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.077207 Oct 28 15:52:33.699294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 837/1715] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:33 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:52:34.710649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:34.711718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:34.718489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:34.718924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:34.719673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:34.720095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:34.779087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e55e4c02-9908-4d01-92dc-86b530952fa9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.072382 Oct 28 15:52:34.779752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 879/1716] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:34 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:35.791612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:35.792647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:35.799453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:35.799895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:35.800685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:35.801117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:35.864188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8dc31c3e-d14e-41b9-a577-b197cac7b215 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28188 microversion: 2.1 time: 0.077071 Oct 28 15:52:35.865152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 838/1717] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:35 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28188 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:36.876336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:36.877348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:36.884985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:36.885427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:36.886237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:36.886662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:36.961799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9e5ccfe-bf06-41b6-b27a-5d7169cc95af tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28479 microversion: 2.1 time: 0.089388 Oct 28 15:52:36.962430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 880/1718] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:36 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28479 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:52:37.973066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:37.974061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:37.980941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:37.981381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:37.982135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:37.982563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:38.057351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-874eb6bb-7515-4ad0-9efb-7b4637e665b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.088127 Oct 28 15:52:38.058145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 839/1719] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:37 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:39.069441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:39.070347 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:39.077103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:39.077537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:39.078282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:39.078702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:39.145048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-244d3e2c-0c6a-4473-8867-75a84831b729 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.079531 Oct 28 15:52:39.145683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 881/1720] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:39 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:40.157179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:40.158061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:40.165310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:40.165749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:40.166504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:40.166932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:40.234460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b1b6c11a-5d13-4990-a964-d492af245747 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.081354 Oct 28 15:52:40.235078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 840/1721] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:40 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:52:41.246989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:41.247904 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:41.254737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:41.255449 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:41.256835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:41.257267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:41.320113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0db056fc-8119-44c9-a1ee-6e61f4c502be tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.077121 Oct 28 15:52:41.320800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 882/1722] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:41 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:42.332230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:42.333251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:42.340710 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:42.341152 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:42.341915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:42.342336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:42.401614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-088589bf-96e1-41a5-bb5b-260c706c526c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.073349 Oct 28 15:52:42.402258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 841/1723] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:42 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:43.414318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:43.415289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:43.422085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:43.422524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:43.423275 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:43.423699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:43.484422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e5f9ce7d-fce2-4785-b0c0-2b36517189f9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.074655 Oct 28 15:52:43.485079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 883/1724] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:43 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:44.496925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:44.497918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:44.504724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:44.505418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:44.506181 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:44.506611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:44.562921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9eb74d06-2e84-4fcb-91a1-e340a1ca221d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.069916 Oct 28 15:52:44.563535 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 842/1725] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:44 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:45.574873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:45.575860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:45.582638 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:45.583074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:45.583829 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:45.584253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:45.646733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b0e4e856-db27-44d1-b013-78c036d799ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.075603 Oct 28 15:52:45.647810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 884/1726] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:45 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:46.659066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:46.660054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:46.667478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:46.667912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:46.668683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:46.669107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:46.729430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f590e142-af5f-42cb-aaf4-b24d50663cd3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.074261 Oct 28 15:52:46.730043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 843/1727] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:46 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:47.742391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:47.743383 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:47.750208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:47.750657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:47.751425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:47.751866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:47.809493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37eb7d0d-1d8e-4bdf-bd95-ea9821ed8b64 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.071625 Oct 28 15:52:47.810143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 885/1728] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:47 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:48.821646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:48.822633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:48.829456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:48.829900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:48.830662 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:48.831088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:48.891699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-de6fd897-b4c5-4185-b033-cb65a2749b72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.073951 Oct 28 15:52:48.892315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 844/1729] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:48 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:52:49.903834 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:49.904879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:49.911738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:49.912182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:49.912969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:49.913929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:49.971549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ed4d6f6b-aa6b-42aa-aba4-2cd30b52b9a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.071659 Oct 28 15:52:49.972183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 886/1730] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:49 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:50.983704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:50.984734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:50.991575 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:50.992023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:50.992870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:50.993255 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:51.051749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1bc2db5e-9812-4aca-a74d-9ca99d22d822 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.072041 Oct 28 15:52:51.052406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 845/1731] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:50 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:52:52.067799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:52.068733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:52.075523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:52.075963 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:52.076747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:52.077181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:52.139973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2c63dc02-1937-47ce-8030-4326523c00ca tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.076290 Oct 28 15:52:52.140866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 887/1732] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:52 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:53.152142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:53.153082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:53.159984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:53.160459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:53.161224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:53.161656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:53.224821 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dfb4de5f-5934-48a3-8efb-59fb34603235 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.077210 Oct 28 15:52:53.225464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 846/1733] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:53 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:54.236565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:54.237555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:54.244269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:54.244742 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:54.245500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:54.245931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:54.309620 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37e5de07-1cfe-486c-8b33-439b0e9193ec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.077050 Oct 28 15:52:54.310254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 888/1734] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:54 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:55.321787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:55.322782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:55.329580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:55.330025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:55.330784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:55.331217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:55.389430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-12c05d03-7325-4e1e-b0e4-eaa94d587dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.071518 Oct 28 15:52:55.390066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 847/1735] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:55 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:56.402155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:56.403185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:56.410026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:56.410468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:56.411223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:56.411653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:56.505137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e6d71c1b-4728-4b88-8316-74ef932b9e10 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.107380 Oct 28 15:52:56.505760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 889/1736] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:56 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:52:57.517764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:52:57.518772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:52:57.526495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:57.526935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:52:57.527718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:52:57.528172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:00.138111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6bc4a210-6e58-47be-a05b-df4b7c7eb9f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 2.624032 Oct 28 15:53:00.138778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 848/1737] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:52:57 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 2626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:01.151054 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:01.152039 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:01.158946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:01.159382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:01.160141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:01.160593 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:01.238464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-24223e79-a450-4951-a2a8-809ea2926cce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.091970 Oct 28 15:53:01.239117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 890/1738] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:01 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:02.250399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:02.251406 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:02.261153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:02.261595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:02.262347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:02.262770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:02.321107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4076fbf9-904a-4a4d-8bdd-52aef063de44 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.074564 Oct 28 15:53:02.321854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 849/1739] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:02 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:03.333617 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:03.334613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:03.341493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:03.341942 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:03.342702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:03.343131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:06.457155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd53a50b-7248-4afd-be0f-3768a5e97cc0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 3.127434 Oct 28 15:53:06.458255 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 891/1740] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:03 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:07.468339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:07.469355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:07.476219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:07.476701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:07.477462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:07.477895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:07.559095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bca4216b-aaaf-4003-a4aa-f9ac5ae1bb6a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.094765 Oct 28 15:53:07.559957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 850/1741] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:07 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:08.571137 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:08.572667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:08.580048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:08.580524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:08.581279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:08.581703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:11.095816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dea26bbf-fdfd-4b96-8256-0aa3b89456aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 2.528455 Oct 28 15:53:11.096459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 892/1742] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:08 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:12.108180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:12.109110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:12.115905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:12.116344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:12.117122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:12.117547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:12.203057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0f8c298d-35a4-4784-9ce5-af2313139009 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.098916 Oct 28 15:53:12.203883 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 851/1743] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:12 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:12.400552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1945569658", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "0ebebb8e-e9b3-4c5a-a83f-e9112f5d49c3"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:12.454804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] validate_networks() for [('0ebebb8e-e9b3-4c5a-a83f-e9112f5d49c3', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:53:12.879233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:53:12.879647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:53:12.880114 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:53:12.880544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:53:12.880957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:53:12.890399 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:12.890772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:12.891554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:12.891979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:12.908066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Getting quotas for project a4edc71432e54043b1d565e37a39506c. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:53:12.912136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Getting quotas for user 62e913a28e9c4564bc6cabef414c25c1 and project a4edc71432e54043b1d565e37a39506c. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:53:12.922806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:53:12.925250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:53:13.047142 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c543615b-027e-4eb6-9661-1ff69ecce881 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650886 Oct 28 15:53:13.047784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 893/1744] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:53:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:53:13.058696 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1ce4f0f0-8c81-42d5-9b00-93a53f476dba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:13.061836 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1ce4f0f0-8c81-42d5-9b00-93a53f476dba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:13.113389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1ce4f0f0-8c81-42d5-9b00-93a53f476dba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:13.120793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1ce4f0f0-8c81-42d5-9b00-93a53f476dba tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1219 microversion: 2.1 time: 0.066748 Oct 28 15:53:13.121684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 852/1745] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:13 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:13.214138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:13.215084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:13.221818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:13.225643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:13.225643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:13.225643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:13.285186 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4f4fed4e-00a4-4058-9fdd-9794c45ec42d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.074768 Oct 28 15:53:13.285825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 894/1746] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:13 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:14.139675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:14.140312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:14.147314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:14.147751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:14.148548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:14.148969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:14.207097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:14.214632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ece49fa4-de81-4ee3-a518-f4be32d6ab41 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1215 microversion: 2.1 time: 0.080245 Oct 28 15:53:14.215275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 853/1747] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:14 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:14.297895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:14.298961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:14.311780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:14.311780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:14.311780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:14.311780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:14.386380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7055503f-86b1-44db-8078-10a24130e6e2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.091827 Oct 28 15:53:14.387026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 895/1748] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:14 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:15.233070 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:15.233675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:15.239725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:15.240164 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:15.240953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:15.241379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:15.301092 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:15.308588 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-acb84a4c-2c37-4a28-81ad-1d57dfbdef1c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1277 microversion: 2.1 time: 0.079138 Oct 28 15:53:15.309148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 854/1749] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:15 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1277 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:15.404951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:15.406069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:15.414494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:15.414935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:15.415702 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:15.416126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:15.484882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f7575ec1-ad68-4dde-8b21-505840c60885 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.084267 Oct 28 15:53:15.486581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 896/1750] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:15 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:16.324935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:16.325550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:16.331657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.335309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.335309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.335309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.428798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6579e291-1981-4169-9b72-8c738326e149"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:16.429959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:16.436982 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.437423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.438344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.439206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.471802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:16.486226 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e1e33d04-cf69-4ac6-a53c-cb87c0c0276d tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.164944 Oct 28 15:53:16.487877 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 855/1751] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:16 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:16.506723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:16.509635 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:16.516649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.517900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.518718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.519179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.603581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a0282277-c641-429f-b75f-d2045e2e9d3a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.101649 Oct 28 15:53:16.605142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 856/1752] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:16 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:16.830257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-cb960639-f813-4961-9ff5-b231abacd833 req-667d09e6-aeab-4e7f-aaae-2194144f1e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b72df304-0e28-4952-a539-2928b1f19391", "tag": "945cbb3b-4860-4e0a-bc0f-8207105a990c"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:16.839749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:53:16.839749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:53:16.854608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-cb960639-f813-4961-9ff5-b231abacd833 req-667d09e6-aeab-4e7f-aaae-2194144f1e27 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:16.855368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-cb960639-f813-4961-9ff5-b231abacd833 req-667d09e6-aeab-4e7f-aaae-2194144f1e27 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:16.873035 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-cb960639-f813-4961-9ff5-b231abacd833 req-667d09e6-aeab-4e7f-aaae-2194144f1e27 service nova] Creating event network-changed:945cbb3b-4860-4e0a-bc0f-8207105a990c for instance b72df304-0e28-4952-a539-2928b1f19391 on hv-cinder-78364 Oct 28 15:53:16.875582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-cb960639-f813-4961-9ff5-b231abacd833 req-667d09e6-aeab-4e7f-aaae-2194144f1e27 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053239 Oct 28 15:53:16.876172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 857/1753] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:53:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:53:17.341530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-57230636-f835-4fc1-a8d0-97a2212a568d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916773 Oct 28 15:53:17.342150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 897/1754] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:53:16 2021] POST /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:53:17.506587 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:17.507272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:17.514088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:17.514542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:17.515315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:17.515743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:17.616095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:17.617146 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:17.624407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:17.624851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:17.625700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:17.626106 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:17.648196 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:17.651720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5a33ffbd-0a0d-4177-9d3c-05d34125e2b9 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.149474 Oct 28 15:53:17.652288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 858/1755] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:17 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:18.027502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3e020222-9839-4c40-ad9a-7a1cf3fa20b6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.415405 Oct 28 15:53:18.028141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 898/1756] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:17 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:18.669101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:18.669709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:18.676019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:18.676498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:18.677320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:18.677753 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:18.794738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:18.801887 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5b3d03dc-13df-4ddb-b49c-97a005256650 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.137178 Oct 28 15:53:18.802478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 859/1757] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:18 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:19.039569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:19.040494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:19.047184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:19.048353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:19.048353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:19.048813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:19.139244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cf815a72-adcc-43db-93c6-3e72810025e7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.103593 Oct 28 15:53:19.143250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 899/1758] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:19 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:19.818254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:19.818855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:19.825592 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:19.826024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:19.826770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:19.827189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:19.948723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:19.956363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-330fdb05-a6c6-472e-ab4b-d768bfb7fd47 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.141693 Oct 28 15:53:19.956939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 860/1759] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:19 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:20.155207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:20.156126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:20.163209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:20.170948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:20.170948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:20.170948 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:20.229102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d2a27610-709c-4268-b740-2fcc789c455d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.077893 Oct 28 15:53:20.229765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 900/1760] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:20 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:20.973829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:20.975158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:20.982055 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:20.982497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:20.983267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:20.983692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:21.107725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:21.114884 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-39dec6c8-2764-47c4-839c-305aa0800a73 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.144729 Oct 28 15:53:21.115453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 861/1761] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:20 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:21.240133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:21.241072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:21.247822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:21.248250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:21.249027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:21.249448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:21.314373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8ccdaa25-43da-41bd-af8c-578e664bf73c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.078154 Oct 28 15:53:21.315055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 901/1762] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:21 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:22.131598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:22.132104 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:22.139095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:22.139531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:22.140277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:22.140725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:22.258468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:22.266399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-666c8ebf-6344-42b5-9f5d-3fa0036e4c6b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.138674 Oct 28 15:53:22.266952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 862/1763] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:22 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:22.327078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:22.328672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:22.335270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:22.335877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:22.336844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:22.337296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:22.412378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4ebfed54-7327-42cb-bc41-c25850083bd8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.089693 Oct 28 15:53:22.416302 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 902/1764] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:22 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:23.283276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:23.283872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:23.290128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:23.290562 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:23.291308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:23.291730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:23.412441 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:23.421642 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bd1d35a8-bc10-4e87-adea-63b5a531f282 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.141895 Oct 28 15:53:23.422404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 863/1765] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:23 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:23.425156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:23.426159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:23.433027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:23.433471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:23.434286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:23.434721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:23.498153 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5be0fc7f-9ea4-4bb9-ab78-ede7a02f6e1e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 28647 microversion: 2.1 time: 0.075537 Oct 28 15:53:23.498837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 903/1766] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:23 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:23.746947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-222923bc-eddc-4c5a-a5c5-edfeee409fec req-42e7e61a-706d-4502-a9ee-165b6411142e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72df304-0e28-4952-a539-2928b1f19391", "name": "network-vif-plugged", "status": "completed", "tag": "945cbb3b-4860-4e0a-bc0f-8207105a990c"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:23.752198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:53:23.752198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:53:23.758960 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-222923bc-eddc-4c5a-a5c5-edfeee409fec req-42e7e61a-706d-4502-a9ee-165b6411142e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:23.760338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-222923bc-eddc-4c5a-a5c5-edfeee409fec req-42e7e61a-706d-4502-a9ee-165b6411142e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:23.770818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-222923bc-eddc-4c5a-a5c5-edfeee409fec req-42e7e61a-706d-4502-a9ee-165b6411142e service nova] Creating event network-vif-plugged:945cbb3b-4860-4e0a-bc0f-8207105a990c for instance b72df304-0e28-4952-a539-2928b1f19391 on hv-cinder-78364 Oct 28 15:53:23.775818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-222923bc-eddc-4c5a-a5c5-edfeee409fec req-42e7e61a-706d-4502-a9ee-165b6411142e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Oct 28 15:53:23.776414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 864/1767] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:53:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:53:24.439228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:24.439925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:24.446760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:24.447202 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:24.447965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:24.448414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:24.511110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:24.512088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:24.517963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:24.518401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:24.519149 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:24.519573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:24.571064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:24.578805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3ea28a9e-ae5b-47a5-9a50-f85624ed1cce tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.144177 Oct 28 15:53:24.579365 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 904/1768] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:24 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:24.609046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2f0b08b1-eff5-4804-82b3-8a5a37a45c4a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 30023 microversion: 2.1 time: 0.102365 Oct 28 15:53:24.609736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 865/1769] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:24 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 30023 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:25.595368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:25.595891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:25.603148 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:25.609966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:25.609966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:25.609966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:25.621026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:25.622176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:25.629869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:25.630596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:25.631925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:25.631925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:25.733695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:25.740987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f081e338-4312-454a-89a1-840e23d71932 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1319 microversion: 2.1 time: 0.149453 Oct 28 15:53:25.742502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 905/1770] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:25 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:25.745953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b9583fde-f7a1-4e4e-b67e-47ffa4b52525 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 31574 microversion: 2.1 time: 0.128889 Oct 28 15:53:25.746781 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 866/1771] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:25 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 31574 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:25.963873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1881915686", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "d24ae9ef-f446-4a47-88b9-f91bd62a5742"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:26.021544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] validate_networks() for [('d24ae9ef-f446-4a47-88b9-f91bd62a5742', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:53:26.416494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:53:26.416950 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:53:26.417417 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:53:26.417818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:53:26.418223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:53:26.426984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.427428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.428253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.428715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.445514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:53:26.449508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for user 7f4be8e5a4a84fa884ba59a98820d5aa and project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:53:26.460902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:53:26.463207 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:53:26.593071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-86f0e62d-8870-45f3-9b1a-eea81732eb3d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632073 Oct 28 15:53:26.594002 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 906/1772] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:53:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:53:26.604789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2a9dd06b-1c5e-4962-85c8-db11d617f683 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:26.605853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2a9dd06b-1c5e-4962-85c8-db11d617f683 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:26.674798 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2a9dd06b-1c5e-4962-85c8-db11d617f683 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:26.681378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2a9dd06b-1c5e-4962-85c8-db11d617f683 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1218 microversion: 2.1 time: 0.081149 Oct 28 15:53:26.682060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 867/1773] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:26 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:26.758679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:26.761623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:26.761745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:26.761829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:26.767196 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.767315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.767630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.767745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.768382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.768516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.768825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.768988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.856512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-88770b68-ade2-45aa-a2de-850272a1e7ad tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 33111 microversion: 2.1 time: 0.099621 Oct 28 15:53:26.856512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 907/1774] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:26 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 33111 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:26.897429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:26.905078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-99c13838-48e3-4dac-96e0-40985a662a56 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1507 microversion: 2.1 time: 0.149647 Oct 28 15:53:26.905645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 868/1775] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:26 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:26.921700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "156dc0a3-d0c0-47bd-b00c-6c514cdf6c36", "device": "/dev/sdb"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:26.923305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:26.930005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.930436 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:26.931177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:26.931595 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:27.673261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9720993c-e97a-4ede-afda-cf02dea93a53 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "POST /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755560 Oct 28 15:53:27.674055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 908/1776] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:53:26 2021] POST /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:27.697920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:27.698521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:27.705372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:27.705948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:27.706872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:27.710223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:27.768959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:27.776486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8f37bf7d-8b37-4d80-9ddd-640aa6fedc0a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1222 microversion: 2.1 time: 0.082141 Oct 28 15:53:27.781695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 869/1777] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:27 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:27.868670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:27.868670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:27.874971 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:27.875417 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:27.876340 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:27.876632 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:27.954124 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-77698e43-3ded-42ee-963c-4513a7c8eadc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 34017 microversion: 2.1 time: 0.090704 Oct 28 15:53:27.954695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 909/1778] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:27 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 34017 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:28.793408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:28.794240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:28.801940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:28.802379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:28.803388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:28.803814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:28.869755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:28.887310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-26d1b8af-f6ec-4278-8bd2-0952fb4898ce tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1288 microversion: 2.1 time: 0.092911 Oct 28 15:53:28.887310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 870/1779] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:28 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:28.966007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:28.967020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:28.973882 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:28.974315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:28.975067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:28.975486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:29.078157 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bd112549-de9e-44ee-8c15-ef5cadc1255b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 35055 microversion: 2.1 time: 0.115831 Oct 28 15:53:29.078749 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 910/1780] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:28 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 35055 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:29.899097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:29.899815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:29.906552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:29.907094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:29.907935 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:29.908451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:30.033467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:30.040527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-648ea649-f67d-4fac-869a-5bef9348811b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.145154 Oct 28 15:53:30.041082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 871/1781] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:29 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:30.090589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:30.091623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:30.100021 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:30.100616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:30.101952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:30.102385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:30.121285 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-dbbdd729-4222-4779-90f3-5cb67b7fd43e req-5938a7e5-586a-4ede-869e-3651fafdec2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c137307-ffa2-4022-8b8a-ebcf2a5af12a", "tag": "70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:30.124021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:53:30.124021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:53:30.131560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-dbbdd729-4222-4779-90f3-5cb67b7fd43e req-5938a7e5-586a-4ede-869e-3651fafdec2c service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:30.133057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-dbbdd729-4222-4779-90f3-5cb67b7fd43e req-5938a7e5-586a-4ede-869e-3651fafdec2c service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:30.145227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-dbbdd729-4222-4779-90f3-5cb67b7fd43e req-5938a7e5-586a-4ede-869e-3651fafdec2c service nova] Creating event network-changed:70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9 for instance 7c137307-ffa2-4022-8b8a-ebcf2a5af12a on hv-cinder-78364 Oct 28 15:53:30.150087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-dbbdd729-4222-4779-90f3-5cb67b7fd43e req-5938a7e5-586a-4ede-869e-3651fafdec2c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034992 Oct 28 15:53:30.150679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 872/1782] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:53:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:30.196327 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8aca1bc4-2c15-4ce4-913d-6bb0f96cd2a7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 36226 microversion: 2.1 time: 0.109721 Oct 28 15:53:30.196998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 911/1783] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:30 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 36226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:31.060003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:31.060777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:31.066740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:31.067184 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:31.067943 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:31.068375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:31.188862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:31.196021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b74fc163-24ae-4cfa-84b3-804d28347dc5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.140414 Oct 28 15:53:31.196602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 873/1784] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:31 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:31.208830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:31.209819 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:31.216590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:31.217024 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:31.218385 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:31.219093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:31.331225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-093c2fb4-2e31-4525-baa8-76a0bb8432c2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 37683 microversion: 2.1 time: 0.126141 Oct 28 15:53:31.331879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 912/1785] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:31 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 37683 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:32.213172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:32.213779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:32.220004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:32.220480 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:32.221245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:32.221674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:32.344754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:32.345752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:32.350387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:32.352188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:32.352670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:32.353438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:32.353867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:32.358497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0d97b3cf-ed7e-4b33-af9e-6c248662d3aa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.148376 Oct 28 15:53:32.359056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 874/1786] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:32 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:32.453427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1019390b-2740-408f-bb7a-b5eefb1e5abc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 38181 microversion: 2.1 time: 0.113784 Oct 28 15:53:32.454103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 913/1787] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:32 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 38181 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:33.375363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:33.375970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:33.382225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:33.382673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:33.383436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:33.383869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:33.465810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:33.466800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:33.473647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:33.474087 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:33.474843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:33.475271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:33.507198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:33.514737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-44191458-3e2f-4969-9c10-f14b14f428cc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.143602 Oct 28 15:53:33.515297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 875/1788] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:33 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:33.546733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ffa25595-c9ea-46fe-ae4c-c6809cc7da09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 38181 microversion: 2.1 time: 0.084744 Oct 28 15:53:33.547360 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 914/1789] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:33 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 38181 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:34.530782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:34.531408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:34.537599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:34.538047 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:34.538806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:34.539236 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:34.557776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:34.558767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:34.565986 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:34.566428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:34.567179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:34.567602 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:34.641618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3999791f-79b3-4a0d-bb96-a458870218f4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 38181 microversion: 2.1 time: 0.087616 Oct 28 15:53:34.645587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 915/1790] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:34 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 38181 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:53:34.660143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:34.667499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-714ed581-bf3e-44d9-bbcc-f221e33491be tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.140380 Oct 28 15:53:34.668779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 876/1791] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:34 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:35.654010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:35.655006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:35.669916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:35.670268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:35.671028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:35.671514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:35.685143 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:35.686462 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:35.693043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:35.693650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:35.697145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:35.697145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:35.750313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ce253ecb-956d-4698-886c-12f0fa078f07 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 38181 microversion: 2.1 time: 0.099809 Oct 28 15:53:35.751440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 916/1792] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:35 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 38181 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:35.823129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:35.831034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1b1b1ec6-9714-42a0-868a-9fc040f1f57d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.149752 Oct 28 15:53:35.831594 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 877/1793] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:35 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:36.762823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:36.763828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:36.770540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:36.770975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:36.771715 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:36.772134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:36.847304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:36.847906 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:36.854057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:36.854504 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:36.855306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:36.855730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:36.977347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:36.984329 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6f9b6ea2-5e73-4937-baf5-15ce50e14e77 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.141247 Oct 28 15:53:36.984907 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 878/1794] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:36 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:38.001112 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:38.001694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:38.007700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:38.008131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:38.008914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:38.009335 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:38.129376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:38.136733 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2ddb669a-6e0a-4402-b0a3-d1ce5bd941ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.139787 Oct 28 15:53:38.137289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 879/1795] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:37 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:39.154243 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:39.154886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:39.161702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:39.162144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:39.162902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:39.163331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:39.279841 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:39.287570 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6b68390e-8664-4612-b7cf-642f8fdb58ed tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.137431 Oct 28 15:53:39.288134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 880/1796] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:39 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:40.015900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fa1d8108-cba8-467e-959d-3a9edc050dfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 200 len: 38312 microversion: 2.1 time: 3.257147 Oct 28 15:53:40.016776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 917/1797] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:36 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 38312 bytes in 3259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:53:40.025974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:40.026459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:40.032544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:40.032988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:40.033743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:40.034177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:40.056805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-66607df8-d652-4ee0-99bd-6251c3124e72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/ips" status: 200 len: 147 microversion: 2.1 time: 0.034353 Oct 28 15:53:40.057365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 881/1798] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:53:40 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:40.309225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:40.310394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:40.322751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:40.323519 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:40.324894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:40.325663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:40.454373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:40.462014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-75062f58-5da7-44fc-8412-c43fdf05fb36 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.160795 Oct 28 15:53:40.462563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 918/1799] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:40 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:41.478704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:41.479384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:41.485463 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:41.485897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:41.486649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:41.487074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:41.608010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:41.616792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0c1e84a0-ac96-44ce-8a1a-11320c18d9d7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.141636 Oct 28 15:53:41.617409 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 882/1800] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:41 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:42.228729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-6f7ea0d6-9184-46bb-ad09-c43c866a7a15 req-1f59fc5d-d088-4218-bad6-42656afaf20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c137307-ffa2-4022-8b8a-ebcf2a5af12a", "name": "network-vif-plugged", "status": "completed", "tag": "70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:42.230213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:53:42.230213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:53:42.237959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-6f7ea0d6-9184-46bb-ad09-c43c866a7a15 req-1f59fc5d-d088-4218-bad6-42656afaf20b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:42.238387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-6f7ea0d6-9184-46bb-ad09-c43c866a7a15 req-1f59fc5d-d088-4218-bad6-42656afaf20b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:42.248809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-6f7ea0d6-9184-46bb-ad09-c43c866a7a15 req-1f59fc5d-d088-4218-bad6-42656afaf20b service nova] Creating event network-vif-plugged:70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9 for instance 7c137307-ffa2-4022-8b8a-ebcf2a5af12a on hv-cinder-78364 Oct 28 15:53:42.254129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-6f7ea0d6-9184-46bb-ad09-c43c866a7a15 req-1f59fc5d-d088-4218-bad6-42656afaf20b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029096 Oct 28 15:53:42.254705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 919/1801] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:42.639199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:42.639855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:42.646074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:42.646517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:42.647284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:42.647714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:42.762843 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee005071-d787-4b20-99bb-9df52adbebd4"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:42.764144 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:42.769287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:42.770145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:42.770578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:42.771369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:42.771791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:42.777126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-888d3777-2086-418c-ba93-a8e41509812d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.141989 Oct 28 15:53:42.777782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 883/1802] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:42 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:43.794199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:43.794799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:43.801542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:43.801981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:43.802735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:43.803158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:43.923731 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:43.931041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4a2e08b2-8f5f-4e27-8fdd-4659a1582bb6 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.140501 Oct 28 15:53:43.931590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 884/1803] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:43 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:44.948347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:44.948970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:44.954813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:44.955250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:44.956003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:44.956450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:45.075680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:45.082771 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bbbfe2b5-7eae-440f-af3e-8b325d7a66cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.138534 Oct 28 15:53:45.083324 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 885/1804] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:44 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:46.099155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:46.099751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:46.105899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:46.106344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:46.107105 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:46.107537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:46.229875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:46.237718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-033f8af2-575b-490f-b792-5dcde63ff5ff tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.142292 Oct 28 15:53:46.238272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 886/1805] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:46 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:47.253941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:47.254604 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:47.260784 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:47.261219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:47.262272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:47.262695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:47.394189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:47.401571 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c0faac2e-6282-4657-a9c6-fff91e3dcae4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.152069 Oct 28 15:53:47.402076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 887/1806] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:47 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:47.584123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cd07c00a-2ea4-4564-a300-4994eab59b35 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.825571 Oct 28 15:53:47.584823 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 920/1807] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:53:42 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments => generated 194 bytes in 4828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:53:48.417680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:48.418284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:48.424647 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:48.425044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:48.425778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:48.426204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:48.544247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:48.551357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a46a1717-fafa-4f96-83ac-cfe2201915eb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1318 microversion: 2.1 time: 0.137402 Oct 28 15:53:48.552325 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 888/1808] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:48 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:49.571370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:49.572059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:49.579161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.579605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.580371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.580827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.706670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:49.714006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a437fb57-e50a-4fd5-ae72-2a14acc294ca tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1509 microversion: 2.1 time: 0.148859 Oct 28 15:53:49.714569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 921/1809] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:49 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:49.730864 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6579e291-1981-4169-9b72-8c738326e149"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:49.731904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:49.738231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.738681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.739460 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.739881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.815202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Invalid volume: volume 6579e291-1981-4169-9b72-8c738326e149 is already attached to instances: 64b88e85-cf04-4bb9-889d-bd9f2846e583 Oct 28 15:53:49.815859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 400 to user: Invalid volume: volume 6579e291-1981-4169-9b72-8c738326e149 is already attached to instances: 64b88e85-cf04-4bb9-889d-bd9f2846e583 {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:53:49.816817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bdba9ee3-9c28-4815-87d8-827638fa42b3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089787 Oct 28 15:53:49.817483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 889/1810] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:53:49 2021] POST /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:53:49.874126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:49.874622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:49.880355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.880830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.881582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:49.882022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:49.957658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lazy-loading 'services' on Instance uuid 64b88e85-cf04-4bb9-889d-bd9f2846e583 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:53:50.224025 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5c4da3e2-e6f6-4c37-bebb-839b687fa6d4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments/6579e291-1981-4169-9b72-8c738326e149" status: 202 len: 0 microversion: 2.1 time: 0.353328 Oct 28 15:53:50.224571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 922/1811] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:53:49 2021] DELETE /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments/6579e291-1981-4169-9b72-8c738326e149 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:53:50.232572 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:50.233536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:50.239974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:50.240435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:50.241209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:50.241643 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:50.271803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3b5a5dbf-9155-4f56-a404-a6321746a255 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042948 Oct 28 15:53:50.272355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 890/1812] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:50 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:53:51.284946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:51.286006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:51.292043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:51.292578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:51.293341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:51.293771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:51.321526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ff0a2657-283f-4b9c-a3c5-18b3377035f5 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041769 Oct 28 15:53:51.322009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 923/1813] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:51 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:51.712127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:51.712653 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:51.718944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:51.719388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:51.720154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:51.720625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:51.796719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lazy-loading 'services' on Instance uuid b72df304-0e28-4952-a539-2928b1f19391 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:53:52.035465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-73adea5a-4ddc-4efb-a398-0b2e525cdf6c tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391/os-volume_attachments/156dc0a3-d0c0-47bd-b00c-6c514cdf6c36" status: 202 len: 0 microversion: 2.1 time: 0.326846 Oct 28 15:53:52.035987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 891/1814] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:53:51 2021] DELETE /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391/os-volume_attachments/156dc0a3-d0c0-47bd-b00c-6c514cdf6c36 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:53:52.332696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:52.333548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:52.339787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:52.340229 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:52.341034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:52.341463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:52.372589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-11ca19f5-2720-4d91-8693-debf113eeb60 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Oct 28 15:53:52.373134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 924/1815] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:52 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:53.384911 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:53.385820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:53.392135 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:53.392617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:53.393373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:53.393801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:53.421334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-108dde3e-194b-4be1-9ec2-88facf82bb29 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041087 Oct 28 15:53:53.422360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 892/1816] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:53 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:54.433237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:54.434187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:54.440335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:54.440797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:54.441576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:54.441994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:54.470985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c55bf1d6-96cc-475c-bd78-c2abf1b7b3b0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 Oct 28 15:53:54.471524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 925/1817] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:54 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:55.482271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:55.483178 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:55.490188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:55.490608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:55.491430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:55.491865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:55.520079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f79c1ddc-4f1c-4562-898e-26489a5b5d43 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Oct 28 15:53:55.520658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 893/1818] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:55 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:53:56.096695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-42bae3a7-ed23-4726-8de6-82d8b010fcfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:56.102900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42bae3a7-ed23-4726-8de6-82d8b010fcfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:56.103338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-42bae3a7-ed23-4726-8de6-82d8b010fcfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:56.164970 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-42bae3a7-ed23-4726-8de6-82d8b010fcfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Going to try to stop instance {{(pid=116431) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 15:53:56.405703 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-42bae3a7-ed23-4726-8de6-82d8b010fcfd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 202 len: 0 microversion: 2.1 time: 0.312517 Oct 28 15:53:56.406299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 926/1819] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:53:56 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:53:56.414159 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:56.418636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:56.420706 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:56.421147 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:56.421901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:56.422831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:56.532382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:56.533336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:56.539298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:56.539748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:56.540683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:56.541113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:56.545805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:56.554336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9c4beb14-f061-40e0-bcbd-1d765d1a9b14 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.143833 Oct 28 15:53:56.557017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 894/1820] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:56 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:56.570933 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d6b62938-ceca-4416-87d7-1145c6d630fb tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043433 Oct 28 15:53:56.571482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 927/1821] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:53:56 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 15:53:56.674669 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1803715595", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "d24ae9ef-f446-4a47-88b9-f91bd62a5742"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:53:56.740121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] validate_networks() for [('d24ae9ef-f446-4a47-88b9-f91bd62a5742', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:53:57.103941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:53:57.104359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:53:57.104905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:53:57.105332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:53:57.105738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:53:57.114758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.118668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.118668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.118668 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.133154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:53:57.137108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for user 7f4be8e5a4a84fa884ba59a98820d5aa and project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:53:57.148339 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:53:57.150651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:53:57.266598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ae697a17-91a8-4500-a909-870b4a271ba4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595573 Oct 28 15:53:57.267240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 895/1822] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:53:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:53:57.276692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-49fc7ce6-4147-4dff-9055-9ca8aecaba8a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:57.277306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-49fc7ce6-4147-4dff-9055-9ca8aecaba8a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:57.337164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-49fc7ce6-4147-4dff-9055-9ca8aecaba8a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:57.344031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:57.345064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:57.345837 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-49fc7ce6-4147-4dff-9055-9ca8aecaba8a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1218 microversion: 2.1 time: 0.072576 Oct 28 15:53:57.346495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 928/1823] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:57 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:57.356559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.356940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.357724 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.358158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.382738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:53:57.571579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:57.572190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:57.579358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.579803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.580635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.581063 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.710576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:57.718339 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ef5a98fb-41b3-40a1-8eef-395ae5f9ed57 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.150556 Oct 28 15:53:57.719061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 929/1824] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:57 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:57.728521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-40751410-bb04-4771-9cf5-6adc8819f072 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 204 len: 0 microversion: 2.1 time: 0.388742 Oct 28 15:53:57.729088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 896/1825] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:53:57 2021] DELETE /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 15:53:57.736809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:57.737415 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:57.743310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.743748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.744534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:57.744962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:57.868603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:57.876377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e0d68e6b-9aac-4f9f-880c-c375a09908f1 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1513 microversion: 2.1 time: 0.143120 Oct 28 15:53:57.876952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 930/1826] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:57 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:58.363942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:58.364667 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:58.370560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.371033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:58.371897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.372321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:58.431870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:58.439397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b736414b-96a1-4a87-a7a6-67e2458dee38 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1222 microversion: 2.1 time: 0.080464 Oct 28 15:53:58.439947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 897/1827] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:58 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:58.734935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:58.735538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:58.742076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.742544 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:58.743301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.743721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:58.860588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:58.868067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14d5a998-9958-4b88-a5a6-9877b31e9fd5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.136772 Oct 28 15:53:58.868660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 931/1828] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:58 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:58.944409 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:58.945019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:58.951018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.951511 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:58.952304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:58.952766 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:59.075802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:59.083749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a6571fc7-c6f9-48f0-a200-881b40677011 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1513 microversion: 2.1 time: 0.194187 Oct 28 15:53:59.084322 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 898/1829] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:58 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:53:59.455307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:59.461379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:59.461683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:59.462123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:59.462896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:59.463321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:59.523397 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:53:59.530542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4b9a7496-2788-4a74-ab28-59fd6d5fdda3 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1288 microversion: 2.1 time: 0.079048 Oct 28 15:53:59.531092 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 932/1830] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:59 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:53:59.885364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:53:59.885929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:53:59.892563 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:59.895605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:53:59.895605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:53:59.895605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:00.023652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:00.031565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8ca4ee94-e43c-4027-8357-aad8f69f43a0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.149887 Oct 28 15:54:00.034508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 899/1831] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:53:59 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:00.099778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:00.100576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:00.106985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:00.107422 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:00.108189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:00.108646 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:00.238061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:00.245603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-50edcb40-0051-4e26-8244-08a2cefd0071 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1513 microversion: 2.1 time: 0.149539 Oct 28 15:54:00.246239 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 933/1832] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:00 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:00.547051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:00.548221 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:00.554601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:00.555045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:00.555820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:00.556252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:00.680869 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:00.688469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-74d2d307-6fec-47ca-bb36-b25d712d12bf tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.145190 Oct 28 15:54:00.689044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 900/1833] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:00 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:01.048560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:01.049108 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:01.054907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.055351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.056104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.056568 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.178565 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:01.186335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d8047717-beaf-4dfc-b106-8134c964f609 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.141543 Oct 28 15:54:01.186895 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 934/1834] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:01 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:01.218019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-1971b1f8-6dbd-460c-b3cf-ae2e14bd4a96 req-3dfca7de-9566-4264-ae42-58f46ed8ca56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5baa7d-5358-40c6-a51c-a34163376b75", "tag": "b3c1dc04-d968-489d-a7e3-5d4f928d3663"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:01.220257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:54:01.220257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:54:01.227232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1971b1f8-6dbd-460c-b3cf-ae2e14bd4a96 req-3dfca7de-9566-4264-ae42-58f46ed8ca56 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.227752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-1971b1f8-6dbd-460c-b3cf-ae2e14bd4a96 req-3dfca7de-9566-4264-ae42-58f46ed8ca56 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.239361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-1971b1f8-6dbd-460c-b3cf-ae2e14bd4a96 req-3dfca7de-9566-4264-ae42-58f46ed8ca56 service nova] Creating event network-changed:b3c1dc04-d968-489d-a7e3-5d4f928d3663 for instance 0f5baa7d-5358-40c6-a51c-a34163376b75 on hv-cinder-78364 Oct 28 15:54:01.244172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-1971b1f8-6dbd-460c-b3cf-ae2e14bd4a96 req-3dfca7de-9566-4264-ae42-58f46ed8ca56 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029884 Oct 28 15:54:01.244778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 901/1835] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:54:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:01.265135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:01.268649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:01.273414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.273896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.274730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.275158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.397398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:01.404969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5ceac68c-05fe-4f40-b014-84157884a850 tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1513 microversion: 2.1 time: 0.145351 Oct 28 15:54:01.405566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 935/1836] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:01 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:01.706162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:01.706857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:01.714209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.714665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.716085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:01.716547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:01.845403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:01.852639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-447e946a-952f-46b4-a65e-e0e11b60cfa0 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.151048 Oct 28 15:54:01.853202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 902/1837] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:01 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:02.202969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:02.203578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:02.209969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.210479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.211241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.211670 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.329504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:02.337096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4855fe00-658e-4d0d-9b9a-ece3620f3622 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.137749 Oct 28 15:54:02.337657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 936/1838] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:02 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:02.421886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:02.422486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:02.428533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.428980 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.429746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.430179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.459536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.459976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.460448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lazy-loading 'fault' on Instance uuid b72df304-0e28-4952-a539-2928b1f19391 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:54:02.499262 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e913a28e9c4564bc6cabef414c25c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4edc71432e54043b1d565e37a39506c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:02.506498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-73ad9b82-9f2a-498f-a22e-66a177e7430b tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 200 len: 1309 microversion: 2.1 time: 0.088223 Oct 28 15:54:02.507060 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 903/1839] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:02 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:02.869428 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:02.869953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:02.875816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.876213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:02.877019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:02.877432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.013273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:03.023538 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1973a72d-a833-48cc-b4f0-aee8b5129a89 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.157725 Oct 28 15:54:03.024179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 937/1840] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:02 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:03.264188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-b51caea5-ec15-40b8-95d0-090a0fcd062c req-89cbd193-2136-40a6-a5d3-37df00fd40ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72df304-0e28-4952-a539-2928b1f19391", "name": "network-vif-deleted", "tag": "945cbb3b-4860-4e0a-bc0f-8207105a990c"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:03.265683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:54:03.265683 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:54:03.273199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-b51caea5-ec15-40b8-95d0-090a0fcd062c req-89cbd193-2136-40a6-a5d3-37df00fd40ed service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:03.273623 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-b51caea5-ec15-40b8-95d0-090a0fcd062c req-89cbd193-2136-40a6-a5d3-37df00fd40ed service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.284376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-b51caea5-ec15-40b8-95d0-090a0fcd062c req-89cbd193-2136-40a6-a5d3-37df00fd40ed service nova] Creating event network-vif-deleted:945cbb3b-4860-4e0a-bc0f-8207105a990c for instance b72df304-0e28-4952-a539-2928b1f19391 on hv-cinder-78364 Oct 28 15:54:03.289052 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-b51caea5-ec15-40b8-95d0-090a0fcd062c req-89cbd193-2136-40a6-a5d3-37df00fd40ed service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028722 Oct 28 15:54:03.289631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 904/1841] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:03.354575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:03.355304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:03.362171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:03.362600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.363475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:03.363902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.485631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:03.493352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ef1e0a95-7a7f-4b41-8e83-73b8ad1d0e94 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.142664 Oct 28 15:54:03.493915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 938/1842] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:03 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:03.524741 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:03.525436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] [instance: b72df304-0e28-4952-a539-2928b1f19391] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:03.531454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:03.532458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.533213 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:03.533638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:03.546081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] HTTP exception thrown: Instance b72df304-0e28-4952-a539-2928b1f19391 could not be found. Oct 28 15:54:03.546664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] Returning 404 to user: Instance b72df304-0e28-4952-a539-2928b1f19391 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:54:03.548034 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-096087d1-b364-4da8-9a7d-52991f4c9bec tempest-VolumesSnapshotTestJSON-492348396 tempest-VolumesSnapshotTestJSON-492348396-project] 10.222.0.86 "GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391" status: 404 len: 111 microversion: 2.1 time: 0.026811 Oct 28 15:54:03.548580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 905/1843] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:03 2021] GET /compute/v2.1/servers/b72df304-0e28-4952-a539-2928b1f19391 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:54:04.041941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:04.042492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:04.049685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:04.052213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:04.052213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:04.052213 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:04.181943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:04.189321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-24e3e514-10b4-4fb8-8966-d1cd8861fe0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.151047 Oct 28 15:54:04.189879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 939/1844] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:04 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:04.509218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:04.509823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:04.516845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:04.517290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:04.518046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:04.518474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:04.639352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:04.646958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6ac34169-5e49-4591-ad3e-35a8fa5d33eb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.141407 Oct 28 15:54:04.647514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 906/1845] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:04 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:05.256504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:05.257116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:05.262856 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:05.263977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:05.264296 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:05.264752 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:05.384503 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:05.392353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cd90f5ec-06dc-4ecb-aac9-8a2ca017912a tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.190602 Oct 28 15:54:05.392932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 940/1846] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:05 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:05.663829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:05.664697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:05.670537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:05.670970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:05.671729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:05.672150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:05.791648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:05.799253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-947a08bf-11a2-4c3f-b75a-eff137e3f3b5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.139219 Oct 28 15:54:05.799809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 907/1847] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:05 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:06.408949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:06.409554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:06.415765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:06.416206 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:06.416988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:06.417414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:06.539332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:06.546462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dbcab0ea-0caa-4d6f-94d5-fe0850d7e139 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.141260 Oct 28 15:54:06.547015 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 941/1848] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:06 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:06.816142 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:06.825934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:06.825934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:06.825934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:06.825934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:06.826276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:06.945233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:06.952920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4f23a718-3295-485a-b46e-44e4d1343908 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.140524 Oct 28 15:54:06.953487 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 908/1849] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:06 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:07.562556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:07.563156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:07.569410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:07.569846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:07.570597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:07.571020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:07.689676 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:07.697010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f17905ac-5699-4514-adef-e0cb891fcc42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.137964 Oct 28 15:54:07.697579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 942/1850] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:07 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:07.971076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:07.971676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:07.977946 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:07.978394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:07.979155 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:07.979587 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:08.099514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:08.107175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5d3cd995-bdf3-4989-80cf-deefc1d78a9c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.140439 Oct 28 15:54:08.107734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 909/1851] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:07 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:08.713784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:08.714396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:08.721321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:08.721815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:08.722567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:08.722996 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:08.842993 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:08.850132 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b46db39d-d2f9-4cf5-b6fe-eeb148ef2084 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.140002 Oct 28 15:54:08.850692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 943/1852] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:08 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:09.123889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:09.124446 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:09.130736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:09.131179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:09.131940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:09.132374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:09.248692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:09.256315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6df1e400-8901-49b1-9e9f-7a4bfe95e216 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.136129 Oct 28 15:54:09.256901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 910/1853] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:09 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:09.867031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:09.867641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:09.873858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:09.874300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:09.875061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:09.875492 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:09.995402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:10.003068 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e80ce616-532c-4657-ab27-f2898185a464 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.139746 Oct 28 15:54:10.003622 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 944/1854] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:09 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:10.272897 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:10.273671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:10.279893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:10.280340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:10.281167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:10.281602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:10.408042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:10.415899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-191b9c6f-cec3-4d20-a598-e90d4e20563d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.146808 Oct 28 15:54:10.416536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 911/1855] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:10 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:11.019987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:11.020623 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:11.026842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:11.027279 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:11.028035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:11.028493 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:11.148718 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:11.155974 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9b34561b-04d1-42e9-b0c6-67bed5f76f48 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.140324 Oct 28 15:54:11.156571 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 945/1856] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:11 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:11.433492 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:11.434136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:11.441071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:11.441516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:11.442276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:11.442713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:11.561501 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:11.570008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8460db51-1e86-441d-9d84-094ad1d19a61 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.140203 Oct 28 15:54:11.570566 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 912/1857] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:11 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:12.172890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:12.174170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:12.179984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:12.180466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:12.181233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:12.181651 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:12.304315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:12.312243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9688cb15-2d8b-4bc7-94e6-3cc3ffba724b tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.143565 Oct 28 15:54:12.312840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 946/1858] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:12 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:12.422495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-6c3e546e-3fa4-42e0-80a7-fb0382bc5438 req-7c8625a8-6abe-4fb2-a87e-d6192d10919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5baa7d-5358-40c6-a51c-a34163376b75", "name": "network-vif-plugged", "status": "completed", "tag": "b3c1dc04-d968-489d-a7e3-5d4f928d3663"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:12.424644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:54:12.424644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:54:12.431583 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c3e546e-3fa4-42e0-80a7-fb0382bc5438 req-7c8625a8-6abe-4fb2-a87e-d6192d10919e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:12.432567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c3e546e-3fa4-42e0-80a7-fb0382bc5438 req-7c8625a8-6abe-4fb2-a87e-d6192d10919e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:12.444974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-6c3e546e-3fa4-42e0-80a7-fb0382bc5438 req-7c8625a8-6abe-4fb2-a87e-d6192d10919e service nova] Creating event network-vif-plugged:b3c1dc04-d968-489d-a7e3-5d4f928d3663 for instance 0f5baa7d-5358-40c6-a51c-a34163376b75 on hv-cinder-78364 Oct 28 15:54:12.450163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-6c3e546e-3fa4-42e0-80a7-fb0382bc5438 req-7c8625a8-6abe-4fb2-a87e-d6192d10919e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Oct 28 15:54:12.450755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 913/1859] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:54:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:12.586836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:12.587433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:12.593716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:12.594159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:12.595001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:12.595618 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:12.714572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:12.730027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c9f7ea4f-c296-45be-b838-7f8169b503aa tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1723 microversion: 2.1 time: 0.146771 Oct 28 15:54:12.730624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 947/1860] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:12 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:13.330133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:13.331655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:13.338470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:13.339027 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:13.340102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:13.340633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:13.472161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:13.482404 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3df9025e-6fea-479a-8829-73c4561efd0d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.156301 Oct 28 15:54:13.482985 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 914/1861] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:13 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:13.746872 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:13.747487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:13.754891 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:13.755324 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:13.756164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:13.756637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:13.879336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:13.887249 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4c2556da-6390-47c7-abb0-1d20b767154b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1700 microversion: 2.1 time: 0.144017 Oct 28 15:54:13.887813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 948/1862] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:13 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1700 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:13.903614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-04dbf90a-44ec-47c2-902c-2132b388d56f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:13.909540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04dbf90a-44ec-47c2-902c-2132b388d56f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:13.909982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-04dbf90a-44ec-47c2-902c-2132b388d56f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:13.971726 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-04dbf90a-44ec-47c2-902c-2132b388d56f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Going to try to start instance {{(pid=116432) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 15:54:14.189688 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-04dbf90a-44ec-47c2-902c-2132b388d56f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 202 len: 0 microversion: 2.1 time: 0.289547 Oct 28 15:54:14.190787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 915/1863] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:54:13 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:54:14.199423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:14.200031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:14.206532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:14.206994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:14.207753 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:14.208180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:14.326855 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:14.335235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dfce615e-f01e-45d9-b8ed-8df186df85fd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1709 microversion: 2.1 time: 0.139548 Oct 28 15:54:14.336380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 949/1864] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:14 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1709 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:14.499964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:14.500697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:14.507375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:14.507818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:14.508658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:14.509091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:14.860982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:14.870713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d50b43a7-d31b-43ab-b17c-c77c3f796463 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1318 microversion: 2.1 time: 0.375228 Oct 28 15:54:14.879994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 916/1865] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:14 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:15.352706 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:15.353298 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:15.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:15.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:15.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:15.368730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:15.479849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:15.487375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-426082fb-6080-43d4-a09b-775b4a51dbb2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1709 microversion: 2.1 time: 0.138497 Oct 28 15:54:15.487928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 950/1866] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:15 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1709 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:15.887183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:15.887777 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:15.894246 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:15.894679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:15.895425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:15.895880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:16.013086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:16.020498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-69418140-5bd0-4657-98fe-12c84eafc8dd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1508 microversion: 2.1 time: 0.136956 Oct 28 15:54:16.021054 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 917/1867] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:15 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1508 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:16.504815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:16.505423 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:16.511645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:16.512088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:16.512884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:16.513356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:16.639886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:16.647801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b0dffa09-5228-4669-a252-10812ab42231 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1713 microversion: 2.1 time: 0.146693 Oct 28 15:54:16.648364 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 951/1868] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:16 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1713 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:17.655573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:17.656653 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:17.663568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:17.664012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:17.664801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:17.665232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:18.395649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2212540c-53a7-4c66-8b63-300173559264 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743201 Oct 28 15:54:18.396416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 918/1869] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:54:17 2021] POST /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:20.730368 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:54:20.730954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:54:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:54:32.264892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:32.266280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:32.272870 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.274695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.274695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.274695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.348521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Invalid volume: volume b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c is already attached to instances: 0f5baa7d-5358-40c6-a51c-a34163376b75 Oct 28 15:54:32.349178 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 400 to user: Invalid volume: volume b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c is already attached to instances: 0f5baa7d-5358-40c6-a51c-a34163376b75 {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:54:32.350668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7db5587b-28bd-4725-9b89-6e5af0bc363e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089576 Oct 28 15:54:32.351209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 952/1870] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:54:32 2021] POST /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 15:54:32.411351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:32.412482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:32.418454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.418832 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.419584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.420012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.498547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lazy-loading 'services' on Instance uuid 0f5baa7d-5358-40c6-a51c-a34163376b75 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:54:32.700975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c50cd661-5c8f-4e0f-aaf2-32c0ca4c1e27 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments/b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c" status: 202 len: 0 microversion: 2.1 time: 0.293915 Oct 28 15:54:32.701477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 919/1871] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:54:32 2021] DELETE /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments/b3ca6c88-69a0-43c2-bcc4-ebaffbc0619c => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:54:32.710868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:32.711797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:32.718807 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.719251 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.719999 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:32.720442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:32.749501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e29bcd89-d8df-4246-857c-a7cc63828e08 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Oct 28 15:54:32.753368 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 953/1872] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:54:32 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:33.764078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:33.765926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:33.775656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:33.776095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:33.776893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:33.777318 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:33.813849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-54e56921-9d2d-4b39-b42b-81dc5d6de951 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056169 Oct 28 15:54:33.814400 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 920/1873] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:54:33 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:34.824789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:34.825697 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:34.831893 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:34.832336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:34.833125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:34.833554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:34.860370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1d0d1234-4eb0-4c97-982b-37e9746b1775 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039365 Oct 28 15:54:34.860940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 954/1874] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:54:34 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:54:34.956538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-625289896", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "d24ae9ef-f446-4a47-88b9-f91bd62a5742"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:35.007304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] validate_networks() for [('d24ae9ef-f446-4a47-88b9-f91bd62a5742', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:54:35.407542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:54:35.407899 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:54:35.408371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:54:35.408810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:54:35.409218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:54:35.418490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:35.418934 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:35.419787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:35.420240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:35.436613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:54:35.440478 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Getting quotas for user 7f4be8e5a4a84fa884ba59a98820d5aa and project a4df9263130f4e45aa80e63b69905f0f. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:54:35.451338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:54:35.453549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:54:35.559892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-21d9a268-1d25-4948-b0b8-1aa9ad02db1e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606714 Oct 28 15:54:35.560652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 921/1875] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:54:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:54:35.570336 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7338fb92-1302-490c-8f95-28a92de660ea tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:35.570943 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7338fb92-1302-490c-8f95-28a92de660ea tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:35.622310 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7338fb92-1302-490c-8f95-28a92de660ea tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:35.628762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7338fb92-1302-490c-8f95-28a92de660ea tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1217 microversion: 2.1 time: 0.062269 Oct 28 15:54:35.629363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 955/1876] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:35 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:36.646100 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:36.646743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:36.652831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:36.653199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:36.653952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:36.654378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:36.717559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:36.725330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e5071ac2-2771-4321-8bfd-34a8ff37c9df tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1221 microversion: 2.1 time: 0.082764 Oct 28 15:54:36.725879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 922/1877] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:36 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:54:37.741603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:37.742553 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:37.748960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:37.749545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:37.750198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:37.750616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:37.822049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:37.831083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f5e80660-63db-48c9-be7b-41ce5b77a819 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1277 microversion: 2.1 time: 0.093824 Oct 28 15:54:37.831816 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 956/1878] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:37 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:38.850780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:38.851385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:38.857727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:38.858266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:38.859118 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:38.859612 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:38.992224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:38.999593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0f10584d-d4fd-4a8d-83f1-e677d3a3cec7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.152467 Oct 28 15:54:39.009732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 923/1879] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:38 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:39.434109 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-07dfc691-f077-452b-a10f-af90a6ce6a19 req-28137271-5509-49b8-bea6-2533e15e7602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf29437-d09f-4fcc-a771-1f92483b9698", "tag": "339d502f-578c-4546-beef-8781d4f4e931"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:39.435695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:54:39.435695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:54:39.442514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-07dfc691-f077-452b-a10f-af90a6ce6a19 req-28137271-5509-49b8-bea6-2533e15e7602 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:39.442983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-07dfc691-f077-452b-a10f-af90a6ce6a19 req-28137271-5509-49b8-bea6-2533e15e7602 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:39.461215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-07dfc691-f077-452b-a10f-af90a6ce6a19 req-28137271-5509-49b8-bea6-2533e15e7602 service nova] Creating event network-changed:339d502f-578c-4546-beef-8781d4f4e931 for instance 3bf29437-d09f-4fcc-a771-1f92483b9698 on hv-cinder-78364 Oct 28 15:54:39.461215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-07dfc691-f077-452b-a10f-af90a6ce6a19 req-28137271-5509-49b8-bea6-2533e15e7602 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153549 Oct 28 15:54:39.461215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 957/1880] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:54:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:40.017075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:40.017684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:40.024267 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:40.026384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:40.027509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:40.027942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:40.153872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:40.161132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4c45d6d3-a597-48e6-b9f9-0f8d23cb4933 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.147864 Oct 28 15:54:40.161692 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 924/1881] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:40 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:41.178550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:41.179245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:41.186161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:41.186635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:41.187353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:41.187814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:41.310745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:41.317944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-927d982f-5713-4beb-b5f7-8980c5f67ba8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.144043 Oct 28 15:54:41.318613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 958/1882] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:41 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:42.334440 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:42.335277 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:42.342384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:42.342828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:42.343595 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:42.344021 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:42.485371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:42.514273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e7398d00-621a-42f3-862f-c9163c26fb99 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.179064 Oct 28 15:54:42.516701 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 925/1883] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:42 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:43.425849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:54:43.431566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:54:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:54:43.534164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:43.534756 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:43.553606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:43.554047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:43.554826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:43.555398 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:43.712931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:43.721940 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cc801d59-d009-4817-9ba1-a308f16643dc tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.191361 Oct 28 15:54:43.723914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 959/1884] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:43 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:44.738797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:44.739486 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:44.745979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:44.746469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:44.747244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:44.747672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:44.900488 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:44.908835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-17369534-9726-4469-9bfc-96db356db0d1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.173494 Oct 28 15:54:44.909567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 926/1885] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:44 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:45.924846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:45.925609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:45.932890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:45.937936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:45.937936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:45.937936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:46.057832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:46.066257 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d3d1bd4d-fb2f-45c1-a10e-d71c234c7876 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.145119 Oct 28 15:54:46.066832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 960/1886] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:45 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:47.033648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-70c53a61-0730-4373-b054-44926e05d804 req-014c8059-7fb3-4c79-bb7f-9a3d77fb82a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf29437-d09f-4fcc-a771-1f92483b9698", "name": "network-vif-plugged", "status": "completed", "tag": "339d502f-578c-4546-beef-8781d4f4e931"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:47.040556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:54:47.040556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:54:47.058915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-70c53a61-0730-4373-b054-44926e05d804 req-014c8059-7fb3-4c79-bb7f-9a3d77fb82a6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:47.064133 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-70c53a61-0730-4373-b054-44926e05d804 req-014c8059-7fb3-4c79-bb7f-9a3d77fb82a6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:47.083578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:47.084875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:47.086684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-70c53a61-0730-4373-b054-44926e05d804 req-014c8059-7fb3-4c79-bb7f-9a3d77fb82a6 service nova] Creating event network-vif-plugged:339d502f-578c-4546-beef-8781d4f4e931 for instance 3bf29437-d09f-4fcc-a771-1f92483b9698 on hv-cinder-78364 Oct 28 15:54:47.091814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:47.092693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:47.092875 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-70c53a61-0730-4373-b054-44926e05d804 req-014c8059-7fb3-4c79-bb7f-9a3d77fb82a6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275582 Oct 28 15:54:47.093758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:47.098204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 927/1887] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:54:47.098311 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:47.244487 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:47.252903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-90c9329b-2078-4cf6-94ea-307fa9e29063 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.172431 Oct 28 15:54:47.253441 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 961/1888] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:47 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:54:48.271207 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:48.273046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:48.279269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:48.279720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:48.280599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:48.281033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:48.449370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:48.457789 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4415789b-a7e1-48a8-a9b9-470df4d7e5e8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1317 microversion: 2.1 time: 0.191141 Oct 28 15:54:48.458453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 928/1889] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:48 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:49.493037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:54:49.493037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:49.503070 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:49.503521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:49.504299 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:49.511545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:50.095596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:54:50.113648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ef16f0b8-edf6-465b-bbc3-de1649a7b301 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1507 microversion: 2.1 time: 0.640060 Oct 28 15:54:50.122722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 962/1890] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:54:49 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:54:51.920292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6a4674-48c1-4e87-b49b-a778a3f630d6"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:51.922036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:54:51.935846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:51.937115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:51.938533 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:54:51.938966 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:54:52.249023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Action: 'create', calling method: .version_select at 0x7fdc1bcfb790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-378413968"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:54:52.266598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for project 9909723fa66c47a1a813ac7796204744. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:54:52.270583 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for user 0ad9a2338a304b39a34043a140a6a367 and project 9909723fa66c47a1a813ac7796204744. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:54:52.442956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for project 9909723fa66c47a1a813ac7796204744. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:54:52.447150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for user 0ad9a2338a304b39a34043a140a6a367 and project 9909723fa66c47a1a813ac7796204744. Resources: {'key_pairs'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:54:52.460660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cdbd860a-21a3-447f-8034-7450292b06d1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.309802 Oct 28 15:54:52.461419 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 963/1891] 10.222.0.86 () {60 vars in 1157 bytes} [Thu Oct 28 15:54:52 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:54:52.593214 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a53ff850-b15f-42de-a863-4f4145410618 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "POST /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676299 Oct 28 15:54:52.593939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 929/1892] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:54:51 2021] POST /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:00.340824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:00.341430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:00.348118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:00.348608 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:00.349375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:00.349803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:00.427745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lazy-loading 'services' on Instance uuid 3bf29437-d09f-4fcc-a771-1f92483b9698 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:55:00.639681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b9dddc9e-a927-48b3-85e5-51647769e4cd tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments/9b6a4674-48c1-4e87-b49b-a778a3f630d6" status: 202 len: 0 microversion: 2.1 time: 0.303144 Oct 28 15:55:00.640271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 964/1893] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:55:00 2021] DELETE /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments/9b6a4674-48c1-4e87-b49b-a778a3f630d6 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:55:00.649772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:00.650904 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:00.657673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:00.662319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:00.662319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:00.662319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:00.687452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7be063ac-6fb6-46b8-b537-65b64acae178 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Oct 28 15:55:00.688008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 930/1894] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:55:00 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:01.700463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:01.701503 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:01.707869 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:01.711123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:01.711123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:01.711123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:01.738280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0072e61b-51fc-4ad8-909f-d36e6e32f81d tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Oct 28 15:55:01.738840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 965/1895] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:55:01 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:02.750223 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:02.751136 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:02.757914 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:02.758353 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:02.759117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:02.759551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:02.787718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6e6ec508-354d-4462-8f98-24cb4d4df8f1 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041217 Oct 28 15:55:02.788498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 931/1896] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:55:02 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:55:04.089010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:04.089548 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:04.095868 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:04.096303 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:04.097079 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:04.097496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:04.126057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:55:04.365183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-04a92bcf-141a-4484-8114-c620e7bb1ef9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 204 len: 0 microversion: 2.1 time: 0.280161 Oct 28 15:55:04.365682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 966/1897] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:55:04 2021] DELETE /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:55:04.373493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:04.375075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:04.380673 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:04.381125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:04.382644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:04.383086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:04.512232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:04.520793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7ec78030-4a0a-447c-bb1d-ea927296bb0e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1513 microversion: 2.1 time: 0.150894 Oct 28 15:55:04.521383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 932/1898] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:04 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:05.537902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:05.539271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:05.545589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:05.546031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:05.546792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:05.547219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:05.671534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:05.679045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c6bb04f2-d16b-4b99-9140-912c729b3fd4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1513 microversion: 2.1 time: 0.145020 Oct 28 15:55:05.679603 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 967/1899] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:05 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:06.695321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:06.695922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:06.702158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:06.702605 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:06.703373 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:06.703894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:06.826410 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:06.832728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9be19b27-6c49-49cc-b9f1-872c0d517743 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1513 microversion: 2.1 time: 0.140965 Oct 28 15:55:06.833351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 933/1900] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:06 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:07.360989 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-943a7cb5-2a03-498e-99be-164896ae719a req-20008f52-f5d8-4377-898c-80198c89cf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf29437-d09f-4fcc-a771-1f92483b9698", "name": "network-vif-deleted", "tag": "339d502f-578c-4546-beef-8781d4f4e931"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:07.362482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:07.362482 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:55:07.370570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-943a7cb5-2a03-498e-99be-164896ae719a req-20008f52-f5d8-4377-898c-80198c89cf50 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:07.371006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-943a7cb5-2a03-498e-99be-164896ae719a req-20008f52-f5d8-4377-898c-80198c89cf50 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:07.383066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-943a7cb5-2a03-498e-99be-164896ae719a req-20008f52-f5d8-4377-898c-80198c89cf50 service nova] Creating event network-vif-deleted:339d502f-578c-4546-beef-8781d4f4e931 for instance 3bf29437-d09f-4fcc-a771-1f92483b9698 on hv-cinder-78364 Oct 28 15:55:07.386968 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-943a7cb5-2a03-498e-99be-164896ae719a req-20008f52-f5d8-4377-898c-80198c89cf50 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029714 Oct 28 15:55:07.387842 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 968/1901] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:55:07.849344 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:07.850041 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:07.856302 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:07.856780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:07.857543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:07.857977 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:07.890968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:07.891408 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:07.891855 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lazy-loading 'fault' on Instance uuid 3bf29437-d09f-4fcc-a771-1f92483b9698 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:55:07.934553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:07.941970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6efdf0aa-7f07-402d-b3a8-235a8ab29e09 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 200 len: 1307 microversion: 2.1 time: 0.096259 Oct 28 15:55:07.942531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 934/1902] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:07 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:08.959908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:08.960844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 3bf29437-d09f-4fcc-a771-1f92483b9698] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:08.968791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:08.969238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:08.970170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:08.970604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:08.983760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Instance 3bf29437-d09f-4fcc-a771-1f92483b9698 could not be found. Oct 28 15:55:08.984352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 404 to user: Instance 3bf29437-d09f-4fcc-a771-1f92483b9698 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:55:08.985242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6472f949-84d2-41cd-9cc0-c67325feeeb4 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698" status: 404 len: 111 microversion: 2.1 time: 0.029917 Oct 28 15:55:08.985769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 969/1903] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:08 2021] GET /compute/v2.1/servers/3bf29437-d09f-4fcc-a771-1f92483b9698 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:55:10.271876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:10.272359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:10.278653 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:10.279088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:10.279833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:10.280253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:10.303451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:55:10.548063 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-646b2e00-8093-4814-afe6-e3bdf7e8d9e7 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 204 len: 0 microversion: 2.1 time: 0.279851 Oct 28 15:55:10.550286 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 935/1904] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:55:10 2021] DELETE /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:55:10.556698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:10.557304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:10.563563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:10.564010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:10.564815 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:10.565274 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:10.686474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:10.693731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f5c4868-4f58-47e8-8a65-d5542b8b2244 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1514 microversion: 2.1 time: 0.140770 Oct 28 15:55:10.694284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 970/1905] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:10 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:11.710709 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:11.711401 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:11.717694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:11.718134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:11.718892 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:11.719319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:11.839139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:11.846250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2867b70a-7648-42d0-a825-7750bf4cddf2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1514 microversion: 2.1 time: 0.139565 Oct 28 15:55:11.846800 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 936/1906] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:11 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:12.862740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:12.863343 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:12.870166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:12.870597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:12.871346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:12.871764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:12.997867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:13.005183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-06f527bc-4fca-44b8-b6d3-58f2849f4295 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1514 microversion: 2.1 time: 0.146055 Oct 28 15:55:13.005840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 971/1907] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:12 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:13.327433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-bed58358-c9ab-447b-95d4-055d2835081e req-bc17d442-a5c2-4b42-982f-503cce99169b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5baa7d-5358-40c6-a51c-a34163376b75", "name": "network-vif-deleted", "tag": "b3c1dc04-d968-489d-a7e3-5d4f928d3663"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:13.329051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:13.329051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:13.336296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-bed58358-c9ab-447b-95d4-055d2835081e req-bc17d442-a5c2-4b42-982f-503cce99169b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:13.336916 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-bed58358-c9ab-447b-95d4-055d2835081e req-bc17d442-a5c2-4b42-982f-503cce99169b service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:13.347524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-bed58358-c9ab-447b-95d4-055d2835081e req-bc17d442-a5c2-4b42-982f-503cce99169b service nova] Creating event network-vif-deleted:b3c1dc04-d968-489d-a7e3-5d4f928d3663 for instance 0f5baa7d-5358-40c6-a51c-a34163376b75 on hv-cinder-78364 Oct 28 15:55:13.353965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-bed58358-c9ab-447b-95d4-055d2835081e req-bc17d442-a5c2-4b42-982f-503cce99169b service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 Oct 28 15:55:13.366578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 937/1908] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:14.022173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:14.022558 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:14.028797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:14.029241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:14.030003 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:14.030433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:14.230775 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:14.231214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:14.231666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lazy-loading 'fault' on Instance uuid 0f5baa7d-5358-40c6-a51c-a34163376b75 {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:55:14.273000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:14.281552 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e618d9a8-199e-48a3-bed4-1674a29a2f8e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 200 len: 1308 microversion: 2.1 time: 0.263670 Oct 28 15:55:14.282128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 972/1909] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:14 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:15.298651 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:15.299338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 0f5baa7d-5358-40c6-a51c-a34163376b75] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:15.305385 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.305826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.307174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.307611 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.321045 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Instance 0f5baa7d-5358-40c6-a51c-a34163376b75 could not be found. Oct 28 15:55:15.321636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 404 to user: Instance 0f5baa7d-5358-40c6-a51c-a34163376b75 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:55:15.323096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-63106710-2ea0-487f-accd-0ea03164f716 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75" status: 404 len: 111 microversion: 2.1 time: 0.028312 Oct 28 15:55:15.323644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 938/1910] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:15 2021] GET /compute/v2.1/servers/0f5baa7d-5358-40c6-a51c-a34163376b75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:55:15.331369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:15.331918 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:15.338136 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.338578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.340507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.340507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.363936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:55:15.647457 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d31f766c-8c40-414d-8b52-5b0d3ff8007e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 204 len: 0 microversion: 2.1 time: 0.319326 Oct 28 15:55:15.647934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 973/1911] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:55:15 2021] DELETE /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 15:55:15.655678 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:15.656333 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:15.662273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.662715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.663479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:15.663913 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:15.783091 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:15.790326 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-15841d55-4d6b-43c2-92a9-b5d278444efa tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1515 microversion: 2.1 time: 0.138318 Oct 28 15:55:15.790880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 939/1912] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:15 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1515 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:16.813116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:16.813116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:16.814913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:16.815348 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:16.816133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:16.816594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:16.941862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:16.950116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ae8dba2b-d964-4096-8d08-194ab7d9cd42 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1515 microversion: 2.1 time: 0.146834 Oct 28 15:55:16.950692 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 974/1913] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:16 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:17.966522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:17.967121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:17.973258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:17.973690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:17.974434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:17.974852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:18.096290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:18.103644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-182b8435-d27d-4863-9218-7c316984f45c tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1515 microversion: 2.1 time: 0.140744 Oct 28 15:55:18.104202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 940/1914] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:17 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1515 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:19.127019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:19.127629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:19.134770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:19.135741 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:19.137064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:19.137499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:19.177376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-d107f5e7-2b5a-4fa0-a9c9-2fb0eb289c46 req-e422f86b-c9b4-4705-bc26-256f4c98f0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c137307-ffa2-4022-8b8a-ebcf2a5af12a", "name": "network-vif-deleted", "tag": "70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:19.178920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:19.178920 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:19.186818 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-d107f5e7-2b5a-4fa0-a9c9-2fb0eb289c46 req-e422f86b-c9b4-4705-bc26-256f4c98f0f2 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:19.187527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-d107f5e7-2b5a-4fa0-a9c9-2fb0eb289c46 req-e422f86b-c9b4-4705-bc26-256f4c98f0f2 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:19.199734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-d107f5e7-2b5a-4fa0-a9c9-2fb0eb289c46 req-e422f86b-c9b4-4705-bc26-256f4c98f0f2 service nova] Creating event network-vif-deleted:70fe383b-a2f3-4c8d-b3d7-2aed92aee3c9 for instance 7c137307-ffa2-4022-8b8a-ebcf2a5af12a on hv-cinder-78364 Oct 28 15:55:19.205650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-d107f5e7-2b5a-4fa0-a9c9-2fb0eb289c46 req-e422f86b-c9b4-4705-bc26-256f4c98f0f2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Oct 28 15:55:19.208949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 941/1915] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:55:19.210219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:19.220313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-04e42bc2-21ee-458b-a5b4-1a3f766a00e2 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 200 len: 1473 microversion: 2.1 time: 0.102436 Oct 28 15:55:19.224524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 975/1916] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:19 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:20.237377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:20.238110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 7c137307-ffa2-4022-8b8a-ebcf2a5af12a] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:20.244082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:20.244561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:20.246115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:20.246548 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:20.261955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Instance 7c137307-ffa2-4022-8b8a-ebcf2a5af12a could not be found. Oct 28 15:55:20.262531 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 404 to user: Instance 7c137307-ffa2-4022-8b8a-ebcf2a5af12a could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:55:20.263332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4954c3a9-c457-4488-bde7-b2cd34f974a8 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a" status: 404 len: 111 microversion: 2.1 time: 0.030565 Oct 28 15:55:20.263854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 942/1917] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:20 2021] GET /compute/v2.1/servers/7c137307-ffa2-4022-8b8a-ebcf2a5af12a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:55:21.525032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:21.525574 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:21.532634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:21.533071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:21.533851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:21.534272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:21.557577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:55:21.864585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-af1f8b9c-d872-4c1c-97eb-0cb4635344ba tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "DELETE /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 204 len: 0 microversion: 2.1 time: 0.342972 Oct 28 15:55:21.865159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 976/1918] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:55:21 2021] DELETE /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:55:21.873362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:21.874040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:21.880624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:21.881065 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:21.881824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:21.882253 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:22.002430 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:22.009797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fe82029c-b652-4687-9518-7db1e47b3b15 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1514 microversion: 2.1 time: 0.140601 Oct 28 15:55:22.010363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 943/1919] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:21 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:55:23.027009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:23.027701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:23.033960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:23.034410 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:23.035225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:23.035648 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:23.160920 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:23.168643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a1d6d109-2a33-4b3d-a59d-e9500ae99b2e tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1514 microversion: 2.1 time: 0.145699 Oct 28 15:55:23.169203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 977/1920] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:23 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:24.058081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-14ce4ca0-4a86-4a1b-966d-36cd390c1f72 req-9bfec037-17e4-44e4-9229-856d544f17d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b88e85-cf04-4bb9-889d-bd9f2846e583", "name": "network-vif-deleted", "tag": "467c0f2a-2891-4497-94f8-386341a69775"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:24.059577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:24.059577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:24.066658 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-14ce4ca0-4a86-4a1b-966d-36cd390c1f72 req-9bfec037-17e4-44e4-9229-856d544f17d6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:24.067099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-14ce4ca0-4a86-4a1b-966d-36cd390c1f72 req-9bfec037-17e4-44e4-9229-856d544f17d6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:24.079315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-14ce4ca0-4a86-4a1b-966d-36cd390c1f72 req-9bfec037-17e4-44e4-9229-856d544f17d6 service nova] Creating event network-vif-deleted:467c0f2a-2891-4497-94f8-386341a69775 for instance 64b88e85-cf04-4bb9-889d-bd9f2846e583 on hv-cinder-78364 Oct 28 15:55:24.085024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-14ce4ca0-4a86-4a1b-966d-36cd390c1f72 req-9bfec037-17e4-44e4-9229-856d544f17d6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030622 Oct 28 15:55:24.085607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 944/1921] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:24.185080 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:24.185678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:24.191866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:24.193589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:24.193589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:24.193589 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:24.257570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4be8e5a4a84fa884ba59a98820d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df9263130f4e45aa80e63b69905f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:24.264883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d51bbc84-2ece-49a7-865a-109ba38045d9 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 200 len: 1472 microversion: 2.1 time: 0.083461 Oct 28 15:55:24.265444 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 978/1922] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:24 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 1472 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:25.282831 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:25.283530 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] [instance: 64b88e85-cf04-4bb9-889d-bd9f2846e583] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:25.290032 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:25.290476 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:25.291234 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:25.291663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:25.304190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] HTTP exception thrown: Instance 64b88e85-cf04-4bb9-889d-bd9f2846e583 could not be found. Oct 28 15:55:25.304796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] Returning 404 to user: Instance 64b88e85-cf04-4bb9-889d-bd9f2846e583 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:55:25.305599 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a13714b7-2eaa-421d-9e02-69676e7ef320 tempest-AttachVolumeNegativeTest-574126403 tempest-AttachVolumeNegativeTest-574126403-project] 10.222.0.86 "GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583" status: 404 len: 111 microversion: 2.1 time: 0.026843 Oct 28 15:55:25.306110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 945/1923] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:25 2021] GET /compute/v2.1/servers/64b88e85-cf04-4bb9-889d-bd9f2846e583 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:55:28.205307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-849357474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-378413968", "security_groups": [{"name": "tempest-secgroup-smoke-535222416"}], "block_device_mapping_v2": [{"uuid": "d187b3c6-6c3b-4f33-be21-f02049f02040", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dd7a3f1-3fb7-4481-b947-a81baecf62e5"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:28.302226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] validate_networks() for [('3dd7a3f1-3fb7-4481-b947-a81baecf62e5', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:55:28.663446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:55:28.663892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:55:28.664358 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:55:28.664881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:55:28.665288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:55:28.674445 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:28.674886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:28.675681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:28.676108 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:28.694857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:55:28.698900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for user 0ad9a2338a304b39a34043a140a6a367 and project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:55:28.760425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:55:28.762562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d187b3c6-6c3b-4f33-be21-f02049f02040',volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:55:29.112375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d2539564-2b0e-4199-8114-93148143614b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.910648 Oct 28 15:55:29.113164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 979/1924] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:55:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:55:29.123505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7745fa64-177d-44dd-8382-c729b278a4fb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:29.124108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7745fa64-177d-44dd-8382-c729b278a4fb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:29.201833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7745fa64-177d-44dd-8382-c729b278a4fb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:29.209202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7745fa64-177d-44dd-8382-c729b278a4fb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1093 microversion: 2.1 time: 0.089916 Oct 28 15:55:29.209998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 946/1925] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:29 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:30.226879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:30.227519 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:30.233590 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:30.237437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:30.237437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:30.237437 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:30.309725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:30.316979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5eeb2d21-0f23-4221-b5e2-96576385d7c3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1143 microversion: 2.1 time: 0.094399 Oct 28 15:55:30.317726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 980/1926] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:30 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:31.333150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:31.333763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:31.340180 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:31.340656 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:31.341417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:31.341848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:31.684066 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:31.691743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8df0e076-82e5-44c4-bc11-d75fe6197367 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1199 microversion: 2.1 time: 0.362475 Oct 28 15:55:31.692403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 947/1927] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:31 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1199 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:32.709507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:32.710116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:32.717055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:32.717498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:32.718273 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:32.718845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:33.021956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:33.024716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-142e9633-8c2b-49bb-84e0-77898476147f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1276 microversion: 2.1 time: 0.318945 Oct 28 15:55:33.025382 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 981/1928] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:32 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:33.297008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-e4b82acf-96ef-489b-986d-db95f63589a3 req-fd857cd3-16e5-4e4a-8736-661e2856d03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfea674-92fa-46b4-9ea8-ed35e5f207b5", "tag": "58f789a9-f15f-4b57-a963-9160fa83d15b"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:33.298645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:33.298645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:33.306288 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e4b82acf-96ef-489b-986d-db95f63589a3 req-fd857cd3-16e5-4e4a-8736-661e2856d03d service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:33.312991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e4b82acf-96ef-489b-986d-db95f63589a3 req-fd857cd3-16e5-4e4a-8736-661e2856d03d service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:33.323435 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-e4b82acf-96ef-489b-986d-db95f63589a3 req-fd857cd3-16e5-4e4a-8736-661e2856d03d service nova] Creating event network-changed:58f789a9-f15f-4b57-a963-9160fa83d15b for instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 on hv-cinder-78364 Oct 28 15:55:33.328806 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-e4b82acf-96ef-489b-986d-db95f63589a3 req-fd857cd3-16e5-4e4a-8736-661e2856d03d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038635 Oct 28 15:55:33.329407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 948/1929] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:34.041795 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:34.042374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:34.049130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:34.049567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:34.050322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:34.050734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:34.179932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:34.187757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-59f44f81-f30c-4c3f-a680-53a10bab6deb tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.149628 Oct 28 15:55:34.188318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 982/1930] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:34 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:35.204722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:35.205416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:35.211824 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:35.212266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:35.213051 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:35.213482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:35.332210 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:35.339416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3556ece5-98cf-4d36-9b61-b7e2c46019c1 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.138793 Oct 28 15:55:35.339965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 949/1931] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:35 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:36.356818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:36.358004 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:36.364313 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:36.364802 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:36.365596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:36.366028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:36.493037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:36.501020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dd950c82-6f05-4062-970c-92164e01936a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.148412 Oct 28 15:55:36.501582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 983/1932] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:36 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:37.517500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:37.518108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:37.524743 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:37.525188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:37.525948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:37.526375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:37.641474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:37.648873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-673a0a1b-3c22-44e8-a767-2e9160361e57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.135087 Oct 28 15:55:37.649433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 950/1933] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:37 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:38.665696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:38.666294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:38.673064 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:38.673508 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:38.674263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:38.674688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:38.796978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:38.804180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-be72221f-16fc-46a2-821d-a83fb5693439 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.142099 Oct 28 15:55:38.804766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 984/1934] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:38 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:39.820878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:39.821483 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:39.828278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:39.828748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:39.829518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:39.829948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:39.949807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:39.957672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-543f2232-8678-44ff-9ae4-6315ac5a472b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.140391 Oct 28 15:55:39.961360 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 951/1935] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:39 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:40.973624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:40.974223 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:40.980332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:40.981582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:40.981582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:40.981969 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:41.100532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:41.107609 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-94e89706-aa6f-4c4b-afb8-09b9fc839407 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.137651 Oct 28 15:55:41.108155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 985/1936] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:40 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:42.123763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:42.124314 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:42.130505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:42.130944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:42.131703 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:42.132131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:42.255141 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:42.262274 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-689a4bb3-b03f-4617-b67c-efa6ee149330 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.142786 Oct 28 15:55:42.268628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 952/1937] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:42 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:43.279916 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:43.280659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:43.287000 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:43.287442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:43.288211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:43.288667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:43.418512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:43.428850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-781177e9-643c-4b97-978b-839f680c3916 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.152456 Oct 28 15:55:43.429421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 986/1938] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:43 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:44.446247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:44.446856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:44.453802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:44.454249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:44.455015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:44.455447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:44.575148 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:44.582388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-06dd3854-4bcb-4b79-8e56-f1bcf89857f7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.139882 Oct 28 15:55:44.582942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 953/1939] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:44 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:45.598125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:45.598729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:45.605030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:45.605471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:45.606226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:45.606654 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:45.724342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:45.731625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-81461a12-2586-4668-9e04-e083afc73186 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.137256 Oct 28 15:55:45.732233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 987/1940] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:45 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:46.748268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:46.748912 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:46.761086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:46.761817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:46.762596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:46.763659 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:46.891010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:46.899300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0637a6c8-a60f-4d61-a070-cf11705ab41f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.155075 Oct 28 15:55:46.899873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 954/1941] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:46 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:46.919866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:46.926433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:46.926547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:46.926994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:46.927766 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:46.928198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:46.978043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-ed41a2dc-3a77-45af-bfd3-843aec4d89b7 req-914362e3-7160-424c-80f4-2a175daf0132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfea674-92fa-46b4-9ea8-ed35e5f207b5", "name": "network-vif-plugged", "status": "completed", "tag": "58f789a9-f15f-4b57-a963-9160fa83d15b"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:46.978043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:46.978043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:46.981536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-ed41a2dc-3a77-45af-bfd3-843aec4d89b7 req-914362e3-7160-424c-80f4-2a175daf0132 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:46.982516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-ed41a2dc-3a77-45af-bfd3-843aec4d89b7 req-914362e3-7160-424c-80f4-2a175daf0132 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:46.994929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-ed41a2dc-3a77-45af-bfd3-843aec4d89b7 req-914362e3-7160-424c-80f4-2a175daf0132 service nova] Creating event network-vif-plugged:58f789a9-f15f-4b57-a963-9160fa83d15b for instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 on hv-cinder-78364 Oct 28 15:55:47.000782 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-ed41a2dc-3a77-45af-bfd3-843aec4d89b7 req-914362e3-7160-424c-80f4-2a175daf0132 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Oct 28 15:55:47.001280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 955/1942] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:47.012205 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lazy-loading 'services' on Instance uuid 882e73f1-1371-4b7f-a683-76e5c9c6a07b {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:55:47.276261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b6987b4c-a5ac-4f2f-8435-34d59676d445 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments/ee005071-d787-4b20-99bb-9df52adbebd4" status: 202 len: 0 microversion: 2.1 time: 0.360428 Oct 28 15:55:47.276975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 988/1943] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:55:46 2021] DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments/ee005071-d787-4b20-99bb-9df52adbebd4 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:55:47.916940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:47.917625 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:47.923539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:47.923982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:47.924803 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:47.925229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:48.044750 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:48.051931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-110bd057-0fa2-4317-b7e8-d157ed7a2a6c tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.139439 Oct 28 15:55:48.052509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 956/1944] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:47 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:49.069737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:49.070425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:49.077513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:49.077613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:49.078381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:49.078818 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:49.208426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:49.215789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-06a5533c-f25d-4a5d-a071-4a1e1bd9f59f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1264 microversion: 2.1 time: 0.150534 Oct 28 15:55:49.217035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 989/1945] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:49 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:49.464833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-74df3691-c35d-4fa5-b7a8-746fc7a3421c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:49.471123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74df3691-c35d-4fa5-b7a8-746fc7a3421c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:49.471569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74df3691-c35d-4fa5-b7a8-746fc7a3421c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:49.492967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-74df3691-c35d-4fa5-b7a8-746fc7a3421c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Going to try to stop instance {{(pid=116432) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 15:55:49.703023 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-74df3691-c35d-4fa5-b7a8-746fc7a3421c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 202 len: 0 microversion: 2.1 time: 0.241874 Oct 28 15:55:49.703617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 957/1946] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:55:49 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:55:49.711481 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:49.712029 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:49.717810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:49.718280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:49.719101 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:49.719532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:49.848902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:49.857231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26888a6c-2c84-4162-880c-2ba91168bdb7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.148827 Oct 28 15:55:49.858005 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 990/1947] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:49 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:50.234121 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:50.234809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:50.243961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.243961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:50.243961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.243961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:50.369596 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:50.377426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0b06015d-a088-4e53-ae03-f4c15bc734e5 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1450 microversion: 2.1 time: 0.148022 Oct 28 15:55:50.378308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 958/1948] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:50 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:50.393596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:50.394193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:50.400866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.401484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:50.402236 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.402659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:50.525513 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:50.532961 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9bbdd28d-cc91-4cc1-b33f-fe17d8adf3bf tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1450 microversion: 2.1 time: 0.143068 Oct 28 15:55:50.533514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 991/1949] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:50 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:55:50.874690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:50.875306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:50.881894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.882315 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:50.883116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:50.883544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:51.032567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:51.040242 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f8077b2e-2b8a-44df-babf-5a0b82c85d01 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.169492 Oct 28 15:55:51.041275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 959/1950] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:50 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:52.057369 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:52.058045 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:52.065022 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:52.065507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:52.066546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:52.066977 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:52.507877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:52.516166 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-10f5c21e-af6c-4919-8649-e3a9ba057ebc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.462373 Oct 28 15:55:52.516805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 992/1951] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:52 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:52.942012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-41295d5f-86de-4181-8c4d-664dd3cacdde req-2b0f509f-3118-4bc8-85c2-9afb04f6cea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfea674-92fa-46b4-9ea8-ed35e5f207b5", "tag": "58f789a9-f15f-4b57-a963-9160fa83d15b"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:55:52.942012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:55:52.942012 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:55:52.946979 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-41295d5f-86de-4181-8c4d-664dd3cacdde req-2b0f509f-3118-4bc8-85c2-9afb04f6cea6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:52.947419 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-41295d5f-86de-4181-8c4d-664dd3cacdde req-2b0f509f-3118-4bc8-85c2-9afb04f6cea6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:52.959383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-41295d5f-86de-4181-8c4d-664dd3cacdde req-2b0f509f-3118-4bc8-85c2-9afb04f6cea6 service nova] Creating event network-changed:58f789a9-f15f-4b57-a963-9160fa83d15b for instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 on hv-cinder-78364 Oct 28 15:55:52.964413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-41295d5f-86de-4181-8c4d-664dd3cacdde req-2b0f509f-3118-4bc8-85c2-9afb04f6cea6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030495 Oct 28 15:55:52.965017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 960/1952] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:55:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:55:53.533586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:53.534292 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:53.540717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:53.541238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:53.542095 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:53.542591 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:53.667850 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:53.675847 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-49b42a8f-b5fa-4504-aaed-b940af2f3e88 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.146013 Oct 28 15:55:53.676652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 993/1953] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:53 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:54.694292 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:54.695017 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:54.701102 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:54.701546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:54.702350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:54.702780 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:54.833293 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:54.840602 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-fdf05293-429f-4cc8-a1ac-1c5713de7785 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.151008 Oct 28 15:55:54.841666 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 961/1954] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:54 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:55.859362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:55.860007 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:55.866402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:55.866797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:55.867561 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:55.867987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:56.026878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:56.034356 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-26ca7799-9612-47b5-b2c9-734c138dbfe7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.179163 Oct 28 15:55:56.034909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 994/1955] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:55 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:57.050746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:57.058219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:57.058219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:57.058219 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:57.058944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:57.059365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:57.178820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:57.186586 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-07e94d07-eb8c-45c4-9688-49344638c6d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.139552 Oct 28 15:55:57.187154 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 962/1956] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:57 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:58.203321 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:58.203935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:58.210219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:58.210724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:58.211489 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:58.211923 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:58.331001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:58.338085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e6b2fd71-fdec-42dc-bd7d-62cf9b2a8406 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.138521 Oct 28 15:55:58.338630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 995/1957] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:58 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:55:59.358556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:55:59.359110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:55:59.365230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:59.366705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:59.366705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:55:59.366968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:55:59.488086 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:55:59.497108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6e70a680-d7d3-4446-a230-b77c3992cea0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.141154 Oct 28 15:55:59.497108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 963/1958] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:55:59 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:00.512532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:00.513135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:00.519401 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:00.519844 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:00.520626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:00.521058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:00.642217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:00.649658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7f579744-d1d4-4de4-9cd5-2abdcfc799bf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.140898 Oct 28 15:56:00.653335 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 996/1959] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:00 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:01.666745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:01.667340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:01.673628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:01.674067 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:01.674817 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:01.675238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:01.804551 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:01.809944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bf2b8ee5-666c-4db5-8b23-2f9998537dde tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.146881 Oct 28 15:56:01.810810 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 964/1960] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:01 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:56:02.826522 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:02.827738 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:02.833498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:02.833931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:02.834683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:02.835102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:02.958035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:02.965559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b3172c4a-875d-45a5-afd0-c63c964ac1ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.142603 Oct 28 15:56:02.966261 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 997/1961] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:02 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:03.982559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:03.983157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:03.989357 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:03.989786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:03.990529 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:03.990951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:04.108745 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:04.115873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-47ee878d-991b-484e-8aff-4d91449d7d6c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.136999 Oct 28 15:56:04.116447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 965/1962] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:03 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:05.132773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:05.133374 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:05.140065 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:05.140541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:05.141303 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:05.141730 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:05.266244 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:05.273780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-495ab1cc-4442-4945-b6cb-b71d54ce98a1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1677 microversion: 2.1 time: 0.144670 Oct 28 15:56:05.274346 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 998/1963] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:05 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:06.291175 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:06.291776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:06.298165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:06.298626 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:06.299403 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:06.299815 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:06.432298 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:06.440247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5d7f9321-ad54-4892-a4de-750a0104b486 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1654 microversion: 2.1 time: 0.152624 Oct 28 15:56:06.441524 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 966/1964] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:06 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:06.458183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-43f88607-2f7a-4c4c-8350-312094446fc6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:56:06.464824 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43f88607-2f7a-4c4c-8350-312094446fc6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:06.465267 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-43f88607-2f7a-4c4c-8350-312094446fc6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:06.486907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-43f88607-2f7a-4c4c-8350-312094446fc6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Going to try to start instance {{(pid=116431) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 15:56:06.662281 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-43f88607-2f7a-4c4c-8350-312094446fc6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action" status: 202 len: 0 microversion: 2.1 time: 0.207624 Oct 28 15:56:06.662911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 999/1965] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:56:06 2021] POST /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:56:06.671537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:06.672144 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:06.677918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:06.678362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:06.679129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:06.679556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:06.860173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:06.867978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-742fdb74-a5c8-4bb0-87bd-8afca9f6ab72 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1663 microversion: 2.1 time: 0.200774 Oct 28 15:56:06.868597 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 967/1966] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:06 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1663 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:07.886581 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:07.891324 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:07.900231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:07.902252 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:07.903193 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:07.903516 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:08.070570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:08.078394 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5b2ba6e9-9878-4794-ab28-cd1340281cb9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1663 microversion: 2.1 time: 0.196937 Oct 28 15:56:08.082762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1000/1967] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:07 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1663 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:56:09.095264 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:56:09.095868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:56:09.101978 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:09.102424 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:09.103212 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:56:09.103649 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:56:09.223854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:56:09.231117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41efb2db-bcde-4ed8-9034-2786a23a098a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1667 microversion: 2.1 time: 0.140063 Oct 28 15:56:09.231714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 968/1968] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:56:09 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1667 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:16.663381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:16.664361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:16.670131 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:16.670576 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:16.671337 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:16.671770 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:16.701910 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0b35d677-d7f9-42f6-b22c-57050b43877b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042925 Oct 28 15:57:16.702883 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1001/1969] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:57:16 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:16.762938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:16.763432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:16.769240 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:16.769684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:16.770469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:16.770895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:16.795132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:57:17.044865 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-96ac0a99-9cf5-45dc-a580-02ed032e2c68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 204 len: 0 microversion: 2.1 time: 0.286169 Oct 28 15:57:17.045356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 969/1970] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:57:16 2021] DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:57:17.053804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:17.054412 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:17.060258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:17.060740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:17.061500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:17.061928 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:17.178762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:17.186006 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5cf7c1fa-6ea9-4a1f-a743-80e07331f4d4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1673 microversion: 2.1 time: 0.136362 Oct 28 15:57:17.186563 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1002/1971] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:17 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1673 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:18.203374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:18.204090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:18.210380 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:18.210820 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:18.211577 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:18.211998 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:18.344176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:18.351945 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1eefa638-e7b3-4c2f-8bad-ab5907addb67 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1673 microversion: 2.1 time: 0.152705 Oct 28 15:57:18.352555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 970/1972] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:18 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:19.369427 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:19.370043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:19.376858 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:19.377435 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:19.378378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:19.378810 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:19.440461 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:19.447962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bc5f34a2-a076-44d8-b412-a026e73de6c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1606 microversion: 2.1 time: 0.082355 Oct 28 15:57:19.452849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1003/1973] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:19 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:19.616704 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-c80d8c8e-cede-4e74-b09f-5472ba9dde67 req-d0b89002-8413-437a-8283-48dfd44d6f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882e73f1-1371-4b7f-a683-76e5c9c6a07b", "name": "network-vif-deleted", "tag": "eb03a5c0-29fe-4a09-a40a-75914262a0e2"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:19.618231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:57:19.618231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:57:19.630296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-c80d8c8e-cede-4e74-b09f-5472ba9dde67 req-d0b89002-8413-437a-8283-48dfd44d6f00 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:19.630296 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-c80d8c8e-cede-4e74-b09f-5472ba9dde67 req-d0b89002-8413-437a-8283-48dfd44d6f00 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:19.636981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-c80d8c8e-cede-4e74-b09f-5472ba9dde67 req-d0b89002-8413-437a-8283-48dfd44d6f00 service nova] Creating event network-vif-deleted:eb03a5c0-29fe-4a09-a40a-75914262a0e2 for instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b on hv-cinder-78364 Oct 28 15:57:19.641823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-c80d8c8e-cede-4e74-b09f-5472ba9dde67 req-d0b89002-8413-437a-8283-48dfd44d6f00 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028750 Oct 28 15:57:19.642399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 971/1974] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:57:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:20.466040 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:20.466644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:20.473066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:20.473592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:20.474459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:20.474979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:20.510849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:20.510849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:20.510849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lazy-loading 'fault' on Instance uuid 882e73f1-1371-4b7f-a683-76e5c9c6a07b {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:57:20.554072 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:20.561994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-091c539d-a69f-44a1-92fb-bfa239c0bfbd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 200 len: 1326 microversion: 2.1 time: 0.099682 Oct 28 15:57:20.562630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1004/1975] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:20 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:21.580417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:21.581099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:21.587843 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:21.588275 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:21.589053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:21.589502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:21.602809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. Oct 28 15:57:21.603379 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:57:21.604176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a314283c-09a4-44fc-b4a5-4e36d36d4536 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 404 len: 111 microversion: 2.1 time: 0.028344 Oct 28 15:57:21.604722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 972/1976] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:21 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:57:21.612724 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c1636a04-2edd-4ceb-9a0d-6129eee49f95 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '.version_select at 0x7fdc1bd4a940>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:21.694506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c1636a04-2edd-4ceb-9a0d-6129eee49f95 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54929674" status: 202 len: 0 microversion: 2.1 time: 0.084714 Oct 28 15:57:21.695088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1005/1977] 10.222.0.86 () {58 vars in 1214 bytes} [Thu Oct 28 15:57:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54929674 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:57:22.499320 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: .version_select at 0x7fdc1bcc6e50>, body: {"keypair": {"name": "tempest-keypair-1801255468"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:22.516172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:57:22.519894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:57:22.531909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [191950d3-d8d5-4c31-92e0-cdd6d084fc1c] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 15:57:23.549389 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [191950d3-d8d5-4c31-92e0-cdd6d084fc1c] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 55794. Oct 28 15:57:24.103929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:57:24.107590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'key_pairs'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:57:24.120640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4c68a4e5-9e15-472f-a403-fcad91af93e5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.624974 Oct 28 15:57:24.121225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 973/1978] 10.222.0.86 () {60 vars in 1157 bytes} [Thu Oct 28 15:57:22 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:26.524259 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1218831843", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c8010e3-a678-4927-bade-213e1fcc742d"}], "security_groups": [{"name": "tempest-securitygroup--950828759"}], "key_name": "tempest-keypair-1801255468", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:26.614061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] validate_networks() for [('9c8010e3-a678-4927-bade-213e1fcc742d', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:57:26.981432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:57:26.981854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:57:26.982363 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:57:26.982772 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:57:26.983181 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:57:26.992535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:26.992865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:26.993668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:26.994097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:27.010461 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:57:27.014322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Getting quotas for user e6d3253cf02e4686821689ba7abbb7ef and project f1888a1cbda247d0897d7f5c5a80a8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:57:27.024811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:57:27.027103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:57:27.146498 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e98be703-1035-435d-91b6-13174d33ada3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.627293 Oct 28 15:57:27.147055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1006/1979] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:57:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:57:27.157467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-eb3650fc-279b-405a-b799-335da39cc014 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:27.158106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-eb3650fc-279b-405a-b799-335da39cc014 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:27.213189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-eb3650fc-279b-405a-b799-335da39cc014 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:27.219629 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-eb3650fc-279b-405a-b799-335da39cc014 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1238 microversion: 2.1 time: 0.066249 Oct 28 15:57:27.220182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 974/1980] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:27 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:28.237432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5605ba59-26f0-4af2-ac2b-517e9944bdce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:28.238103 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5605ba59-26f0-4af2-ac2b-517e9944bdce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:28.289630 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-5605ba59-26f0-4af2-ac2b-517e9944bdce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:28.295899 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5605ba59-26f0-4af2-ac2b-517e9944bdce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1238 microversion: 2.1 time: 0.062895 Oct 28 15:57:28.296504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1007/1981] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:28 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:29.311961 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-161a66bd-d3c8-4581-b852-6ccb15f1e2d6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:29.312606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-161a66bd-d3c8-4581-b852-6ccb15f1e2d6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:29.364229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-161a66bd-d3c8-4581-b852-6ccb15f1e2d6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:29.373186 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-161a66bd-d3c8-4581-b852-6ccb15f1e2d6 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1238 microversion: 2.1 time: 0.064909 Oct 28 15:57:29.373723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 975/1982] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:29 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:30.390429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4c5256d0-7383-4e97-8523-5a16a4045a5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:30.391359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4c5256d0-7383-4e97-8523-5a16a4045a5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:30.449314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-4c5256d0-7383-4e97-8523-5a16a4045a5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:30.455884 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4c5256d0-7383-4e97-8523-5a16a4045a5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1238 microversion: 2.1 time: 0.069099 Oct 28 15:57:30.456490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1008/1983] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:30 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:31.472407 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:31.473015 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:31.478981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:31.479426 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:31.480187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:31.480650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:31.537922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:31.545037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-77d02c85-517a-49c0-b2c6-75148436c963 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1242 microversion: 2.1 time: 0.076323 Oct 28 15:57:31.545600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 976/1984] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:31 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:32.562535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:32.563128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:32.569585 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:32.570027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:32.570791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:32.571220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:32.629156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:32.636733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-22ee6935-9e56-44bd-8603-26d8c8dba43d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1290 microversion: 2.1 time: 0.077914 Oct 28 15:57:32.637286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1009/1985] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:32 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1290 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:33.561585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:57:33.562059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 15:57:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 15:57:33.653502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:33.654108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:33.660313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:33.660793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:33.661559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:33.661992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:33.724581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:33.732331 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-3785b725-24a5-4785-ab1f-b935bc7a1d4d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1296 microversion: 2.1 time: 0.082788 Oct 28 15:57:33.735162 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 977/1986] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:33 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:34.688851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-e018c134-8beb-4617-b0c5-fbd8a81649fc req-ab0c878d-2827-4d09-ab68-6be02add5fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd314ce5-d7eb-411d-b1b1-c972d8e65052", "tag": "915bfb20-89e8-43b4-bdbe-8b05ff02b595"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:34.691550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:57:34.691550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:57:34.699211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-e018c134-8beb-4617-b0c5-fbd8a81649fc req-ab0c878d-2827-4d09-ab68-6be02add5fef service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:34.699681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-e018c134-8beb-4617-b0c5-fbd8a81649fc req-ab0c878d-2827-4d09-ab68-6be02add5fef service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:34.712953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-e018c134-8beb-4617-b0c5-fbd8a81649fc req-ab0c878d-2827-4d09-ab68-6be02add5fef service nova] Creating event network-changed:915bfb20-89e8-43b4-bdbe-8b05ff02b595 for instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 on hv-cinder-78364 Oct 28 15:57:34.718138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-e018c134-8beb-4617-b0c5-fbd8a81649fc req-ab0c878d-2827-4d09-ab68-6be02add5fef service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032830 Oct 28 15:57:34.718726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1010/1987] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:57:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:34.753962 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:34.754617 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:34.763767 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:34.767593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:34.767593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:34.767593 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:34.902361 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:34.910509 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-4a5070db-7d4f-47f9-8a79-919cdfed7e63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.164673 Oct 28 15:57:34.911076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 978/1988] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:34 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:35.927331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:35.928019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:35.934915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:35.935351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:35.936102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:35.936959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:36.056450 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:36.063709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dfc2ffce-957c-4850-aa86-e55db85f42a2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.140329 Oct 28 15:57:36.064265 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1011/1989] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:35 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:37.081188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:37.081725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:37.087879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:37.088328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:37.089110 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:37.089539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:37.211804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:37.218942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cd0d655e-618f-49a7-a2f4-88bf8aef6804 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.141541 Oct 28 15:57:37.219491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 979/1990] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:37 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:38.236188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:38.236826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:38.243751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:38.244197 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:38.244994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:38.245424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:38.361228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:38.368979 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a593ba8b-8e47-4d9b-9ce3-0bd1dbb76d0a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.136557 Oct 28 15:57:38.369532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1012/1991] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:38 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:39.386024 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:39.386676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:39.392902 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:39.396867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:39.396867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:39.396867 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:39.524502 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:39.532040 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-54ae6272-a068-4613-ab6d-a8eedc7ae810 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.150147 Oct 28 15:57:39.532644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 980/1992] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:39 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:40.548768 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:40.549373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:40.556120 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:40.556588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:40.557349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:40.557776 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:40.677159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:40.684915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c64b41de-394a-4867-a519-3fb940ead759 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.139754 Oct 28 15:57:40.685476 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1013/1993] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:40 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:41.459755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-8f4e1575-b8f3-4986-b516-e1aeb5a7d076 req-3d3f9213-056d-450d-a9e4-6653ce4e26c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd314ce5-d7eb-411d-b1b1-c972d8e65052", "name": "network-vif-plugged", "status": "completed", "tag": "915bfb20-89e8-43b4-bdbe-8b05ff02b595"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:41.461949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:57:41.461949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:57:41.470664 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8f4e1575-b8f3-4986-b516-e1aeb5a7d076 req-3d3f9213-056d-450d-a9e4-6653ce4e26c4 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:41.471099 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-8f4e1575-b8f3-4986-b516-e1aeb5a7d076 req-3d3f9213-056d-450d-a9e4-6653ce4e26c4 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:41.482183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-8f4e1575-b8f3-4986-b516-e1aeb5a7d076 req-3d3f9213-056d-450d-a9e4-6653ce4e26c4 service nova] Creating event network-vif-plugged:915bfb20-89e8-43b4-bdbe-8b05ff02b595 for instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 on hv-cinder-78364 Oct 28 15:57:41.487454 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-8f4e1575-b8f3-4986-b516-e1aeb5a7d076 req-3d3f9213-056d-450d-a9e4-6653ce4e26c4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 Oct 28 15:57:41.488069 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 981/1994] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:57:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:41.702135 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:41.702748 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:41.709057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:41.709501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:41.710270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:41.710704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:41.837587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:41.844909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d1789499-33bf-4834-91ef-500bec6bb7b1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.146658 Oct 28 15:57:41.845479 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1014/1995] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:41 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:42.862590 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:42.863303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:42.869170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:42.869614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:42.870366 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:42.870823 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:42.997119 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:43.004225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e7c112e7-3372-4979-8de8-279996bb42cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1363 microversion: 2.1 time: 0.146150 Oct 28 15:57:43.004816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 982/1996] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:42 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:44.021737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:44.022342 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:44.029331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:44.029771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:44.030528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:44.030959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:44.150439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:57:44.157825 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1135a433-0ea0-4445-861e-40b2429736fe tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1550 microversion: 2.1 time: 0.139770 Oct 28 15:57:44.158376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1015/1997] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:57:44 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1550 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:57:44.173992 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:57:44.174470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:44.180497 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:44.180938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:44.181714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:44.182139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:44.258094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-5d7b4bb3-57e4-46e0-9c99-9b4de689dac4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087597 Oct 28 15:57:44.258687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 983/1998] 10.222.0.86 () {58 vars in 1274 bytes} [Thu Oct 28 15:57:44 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:45.197932 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:45.198846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:45.207096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:45.207614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:45.208600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:45.209116 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:45.266210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fe2dd858-3bf9-49fd-9a95-44154ed2b28f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.072019 Oct 28 15:57:45.266988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1016/1999] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:45 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:45.329351 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-a3c38a41-cdd6-41ab-a751-d3a39162c505 req-7960eb3f-4a06-4280-ab2f-99ad5dbb2e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd314ce5-d7eb-411d-b1b1-c972d8e65052", "tag": "915bfb20-89e8-43b4-bdbe-8b05ff02b595"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:45.331417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:57:45.331417 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:57:45.338237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-a3c38a41-cdd6-41ab-a751-d3a39162c505 req-7960eb3f-4a06-4280-ab2f-99ad5dbb2e89 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:45.338672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-a3c38a41-cdd6-41ab-a751-d3a39162c505 req-7960eb3f-4a06-4280-ab2f-99ad5dbb2e89 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:45.349636 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-a3c38a41-cdd6-41ab-a751-d3a39162c505 req-7960eb3f-4a06-4280-ab2f-99ad5dbb2e89 service nova] Creating event network-changed:915bfb20-89e8-43b4-bdbe-8b05ff02b595 for instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 on hv-cinder-78364 Oct 28 15:57:45.359044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-a3c38a41-cdd6-41ab-a751-d3a39162c505 req-7960eb3f-4a06-4280-ab2f-99ad5dbb2e89 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158696 Oct 28 15:57:45.359044 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 984/2000] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:46.277570 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:46.278832 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:46.285696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:46.286134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:46.286888 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:46.287325 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:46.347468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f63f59a4-6f63-46e5-9564-fe4980cef444 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.074550 Oct 28 15:57:46.348119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1017/2001] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:46 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:47.359187 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:47.360163 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:47.366111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:47.366578 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:47.367317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:47.367738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:47.422372 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-36fb5bf9-fc47-4339-a56b-368cf1e0a3fc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.067523 Oct 28 15:57:47.422955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 985/2002] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:47 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:48.433626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:48.434619 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:48.441462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:48.441907 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:48.442664 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:48.443096 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:48.509512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-601d5289-41ac-4e31-8f59-da53a704ad4e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.079725 Oct 28 15:57:48.510117 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1018/2003] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:48 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:49.520749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:49.521729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:49.529284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:49.529721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:49.530466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:49.530882 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:49.596713 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b0ff7d10-92e9-4b4f-b507-c733d890ee25 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.079792 Oct 28 15:57:49.597303 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 986/2004] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:49 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:50.607985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:50.609048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:50.615897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:50.616344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:50.617127 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:50.617564 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:50.672729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bff07346-0788-4173-8b70-322e83a76044 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.068573 Oct 28 15:57:50.673483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1019/2005] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:50 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:51.684528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:51.685547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:51.692276 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:51.692751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:51.693505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:51.693931 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:51.751671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1337e3c7-c688-4f43-91fb-2ee40b78d467 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.071393 Oct 28 15:57:51.752289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 987/2006] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:51 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:52.763560 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:52.764582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:52.771375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:52.771817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:52.772601 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:52.773028 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:52.830925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c5417231-9bbd-4e69-892e-314f2d1bb81c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.071285 Oct 28 15:57:52.831594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1020/2007] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:52 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:53.842456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:53.843359 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:53.850079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:53.850516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:53.851269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:53.851697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:53.911258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2adcae60-c140-4ad6-927a-6415a749213d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 14 microversion: 2.1 time: 0.072768 Oct 28 15:57:53.911901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 988/2008] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:53 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:57:54.922314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:54.923307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:54.930107 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:54.931164 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:54.931924 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:54.932350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:55.002669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-2f1cb464-fb8f-4f32-9696-37b88a3613d7 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 630 microversion: 2.1 time: 0.084154 Oct 28 15:57:55.003211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1021/2009] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:54 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 630 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:57:56.014536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:56.015538 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:56.022308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:56.022756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:56.023514 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:56.023949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:56.092687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-59e9db5b-5df9-4bb2-b60c-cee20d5f3154 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 13967 microversion: 2.1 time: 0.081969 Oct 28 15:57:56.093321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 989/2010] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:56 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 13967 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:57:57.104090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:57.105030 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:57.111682 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:57.112119 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:57.112890 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:57.113315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:57.187687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ca2483f2-0559-47c1-8daa-5c6300029fdb tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 18398 microversion: 2.1 time: 0.088000 Oct 28 15:57:57.188353 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1022/2011] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:57 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 18398 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:57:58.199924 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:58.200964 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:58.207837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:58.208289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:58.209077 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:58.209505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:58.278880 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-de85bdc3-a39c-4c94-839c-c304754b01b9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 19342 microversion: 2.1 time: 0.083336 Oct 28 15:57:58.279748 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 990/2012] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:58 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 19342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:57:59.291452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:57:59.292459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:57:59.299217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:59.299658 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:59.300429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:57:59.300862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:57:59.367988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3e3505d1-7151-4d41-8fe1-c118c83c4bb4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 22021 microversion: 2.1 time: 0.081054 Oct 28 15:57:59.368624 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1023/2013] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:57:59 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 22021 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:00.379484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:00.380503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:00.387252 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:00.387699 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:00.388484 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:00.388947 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:00.456895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1578280e-dba9-4179-b3b2-6ce4d3f48afd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 23235 microversion: 2.1 time: 0.081243 Oct 28 15:58:00.457499 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 991/2014] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:00 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 23235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:01.468657 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:01.469652 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:01.476466 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:01.481375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:01.481375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:01.481375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:01.555009 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b9a6258e-de6a-472f-86c3-afa75d66c7e4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 25127 microversion: 2.1 time: 0.090076 Oct 28 15:58:01.555525 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1024/2015] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:01 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 25127 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:02.566719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:02.567751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:02.575208 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:02.575639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:02.576402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:02.576849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:02.651560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e430969d-1024-4ed2-86b9-1857b9ba3f5c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 26627 microversion: 2.1 time: 0.088911 Oct 28 15:58:02.652458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 992/2016] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:02 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 26627 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:03.663189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:03.664185 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:03.671592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:03.672038 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:03.672827 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:03.673256 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:03.748431 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-274f5f78-d8e9-4b36-aba0-029dffc6fa5d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 27758 microversion: 2.1 time: 0.089076 Oct 28 15:58:03.750773 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1025/2017] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:03 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 27758 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:04.759663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:04.761244 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:04.768128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:04.768615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:04.769378 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:04.769885 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:04.842291 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0aef73dc-cfa4-4e8b-904d-7e45bb299586 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28008 microversion: 2.1 time: 0.086535 Oct 28 15:58:04.842927 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 993/2018] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:04 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28008 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:05.854597 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:05.855522 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:05.862332 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:05.862780 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:05.863545 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:05.863975 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:05.952367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fd2de0ea-9fba-40a6-8875-a0174e0a363f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.101807 Oct 28 15:58:05.953250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1026/2019] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:05 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:06.965096 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:06.966088 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:06.975910 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:06.976490 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:06.977280 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:06.980660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:07.043167 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0f75f639-b149-4409-a058-d2b672691933 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.081904 Oct 28 15:58:07.043857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 994/2020] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:06 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:08.055134 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:08.056196 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:08.063530 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:08.063974 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:08.064769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:08.065203 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:08.125048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1bdb37d8-9a34-4078-a388-305971f59e9d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.073837 Oct 28 15:58:08.125665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1027/2021] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:08 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:09.137700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:09.138607 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:09.145422 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:09.145863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:09.146620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:09.147048 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:09.235321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-638f7402-902a-489e-9221-d6d9c2c55c7a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.102068 Oct 28 15:58:09.235965 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 995/2022] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:09 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:10.247521 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:10.248536 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:10.255451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:10.255894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:10.256687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:10.257115 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:10.315082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-86451350-4089-4c12-a4a2-b09f07780f12 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.071963 Oct 28 15:58:10.315691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1028/2023] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:10 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:11.327729 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:11.328671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:11.335684 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:11.336127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:11.336929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:11.337358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:11.397247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-72f1843e-0ec7-4edd-b188-ef1b2101c0ae tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.074198 Oct 28 15:58:11.397898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 996/2024] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:11 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:12.409830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:12.410826 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:12.418209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:12.418663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:12.419424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:12.419851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:12.485721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ce50799a-05d8-4d9c-8a34-0910e264a2dd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.079670 Oct 28 15:58:12.486309 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1029/2025] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:12 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:13.497848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:13.498872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:13.505804 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:13.506249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:13.507009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:13.507482 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:13.567795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1304f177-d10d-4202-a81e-028b7a3a0782 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.073841 Oct 28 15:58:13.568445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 997/2026] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:13 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:14.579572 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:14.580611 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:14.587376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:14.587821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:14.588789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:14.589225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:14.656701 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-9046443c-35ba-47de-89bd-a710db42886c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.081042 Oct 28 15:58:14.657315 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1030/2027] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:14 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:15.667981 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:15.669022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:15.675751 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:15.676193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:15.676984 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:15.677413 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:15.737120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9f630b1b-6bf3-44b6-bcdc-fa958e4ea177 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.072751 Oct 28 15:58:15.738115 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 998/2028] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:15 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:16.756180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:16.757305 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:16.765889 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:16.766350 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:16.767160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:16.767587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:16.828204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6652bd98-b089-4aa0-b900-136fbe571b7b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.075836 Oct 28 15:58:16.829163 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1031/2029] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:16 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:17.839851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:17.840849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:17.847523 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:17.847959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:17.848797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:17.849227 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:17.907082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6b4e5664-500f-47d1-9953-49ca536fab38 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.071320 Oct 28 15:58:17.907707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 999/2030] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:17 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:18.919059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:18.920059 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:18.926913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:18.927361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:18.928120 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:18.928582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:19.005180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ac7acf82-ef6a-4fb9-845d-cdca818162c1 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28304 microversion: 2.1 time: 0.089936 Oct 28 15:58:19.005739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1032/2031] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:18 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:20.017402 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:20.018352 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:20.025068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:20.025508 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:20.026254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:20.026681 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:20.107553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e8836623-07a6-44a2-b3af-013bd832911c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28595 microversion: 2.1 time: 0.094114 Oct 28 15:58:20.108191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1000/2032] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:20 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28595 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:21.119497 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:21.120532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:21.127391 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:21.127833 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:21.128628 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:21.129060 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:21.205155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c227b389-8aee-4e92-bd76-207c6dbc7f82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.089571 Oct 28 15:58:21.205790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1033/2033] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:21 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:22.217861 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:22.218856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:22.225543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:22.225976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:22.226720 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:22.227140 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:22.292505 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-283f5cbd-4d8e-4be9-8ff0-2a1f660dc0a3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.079152 Oct 28 15:58:22.293737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1001/2034] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:22 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:23.305133 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:23.306126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:23.313523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:23.313965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:23.314722 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:23.315150 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:23.390757 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fbe73759-c8bb-4aa0-b0ca-142a3a72d72a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.089547 Oct 28 15:58:23.391376 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1034/2035] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:23 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:24.403445 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:24.404455 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:24.411429 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:24.411878 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:24.412652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:24.413078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:24.629682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0a4a96f3-dc93-492a-ae38-9353743538cf tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.230658 Oct 28 15:58:24.630297 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1002/2036] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:24 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:25.642139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:25.643138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:25.649960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:25.650408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:25.651167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:25.651600 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:25.720698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-58560d47-6465-4af0-9574-40ed96b1aa4c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.082358 Oct 28 15:58:25.721333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1035/2037] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:25 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:26.733392 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:26.734374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:26.741247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:26.751795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:26.751795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:26.751795 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:26.802744 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b192204c-9acd-4277-93f2-db52d7a375bd tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.073980 Oct 28 15:58:26.803520 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1003/2038] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:26 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:27.815531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:27.816486 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:27.823254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:27.823725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:27.824555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:27.824985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:27.904944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-3f2bd92b-5850-41e0-93ba-25a183acc413 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.092801 Oct 28 15:58:27.906359 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1036/2039] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:27 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:28.918077 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:28.919081 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:28.925740 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:28.926179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:28.926929 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:28.927347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:28.986697 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a0012d29-2939-4619-b146-bd8dd7d38ec9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.072614 Oct 28 15:58:28.987420 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1004/2040] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:28 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:29.998951 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:29.999944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:30.006744 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.007180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:30.007935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.008361 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:30.067085 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5997b1e7-5bca-4191-b283-b563753ba33e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.072064 Oct 28 15:58:30.067685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1037/2041] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:29 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:30.592129 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:30.592746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:30.599554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.599996 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:30.600805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.601556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:30.626189 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:58:30.914813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-8e10b876-14a4-4290-b7cd-2b3f763cc29e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 204 len: 0 microversion: 2.1 time: 0.326364 Oct 28 15:58:30.915341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1005/2042] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:58:30 2021] DELETE /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:58:30.924189 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:30.924908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:30.931379 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.931822 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:30.932604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:30.933031 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:31.055483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:31.063873 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-145c5a6f-a909-4a72-b800-d43531c4d487 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1574 microversion: 2.1 time: 0.143710 Oct 28 15:58:31.064469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1038/2043] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:30 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:31.079495 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:31.082300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:31.087991 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:31.088468 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:31.089233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:31.089747 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:31.152652 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e4b7f822-24dd-4647-ac3e-0ef0e3ddb9ce tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.076513 Oct 28 15:58:31.156118 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1006/2044] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:31 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:32.081051 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:32.081661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:32.087894 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:32.088341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:32.089126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:32.089555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:32.165123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:32.166106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:32.173477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:32.173921 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:32.174690 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:32.175116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:32.210555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:32.217857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8359ef0d-afc3-41d5-96ca-c8bdc0f62c45 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1574 microversion: 2.1 time: 0.140457 Oct 28 15:58:32.218421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1039/2045] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:32 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1574 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:32.312893 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0d7eaad6-5567-4e98-a853-3dfb11503993 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.151559 Oct 28 15:58:32.313585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1007/2046] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:32 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:33.234903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:33.235549 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:33.241660 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:33.242330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:33.243104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:33.243533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:33.325940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:33.327084 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:33.334009 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:33.334559 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:33.335427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:33.335933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:33.368162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:33.375535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-68d14312-3f75-43ec-809d-3caef101e6c6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1574 microversion: 2.1 time: 0.144670 Oct 28 15:58:33.379987 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1040/2047] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:33 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:33.406208 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f27d0e2e-d494-42b3-97d5-8792d3cf7f2f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.084742 Oct 28 15:58:33.408101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1008/2048] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:33 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:33.734159 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-33d773c6-bee5-4cfe-bca2-c2bf766056dd req-a0f0fc8c-d82a-4a48-8ca2-8d89485525fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfea674-92fa-46b4-9ea8-ed35e5f207b5", "name": "network-vif-deleted", "tag": "58f789a9-f15f-4b57-a963-9160fa83d15b"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:33.736214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:58:33.736214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:58:33.750580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-33d773c6-bee5-4cfe-bca2-c2bf766056dd req-a0f0fc8c-d82a-4a48-8ca2-8d89485525fb service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:33.750580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-33d773c6-bee5-4cfe-bca2-c2bf766056dd req-a0f0fc8c-d82a-4a48-8ca2-8d89485525fb service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:33.762704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-33d773c6-bee5-4cfe-bca2-c2bf766056dd req-a0f0fc8c-d82a-4a48-8ca2-8d89485525fb service nova] Creating event network-vif-deleted:58f789a9-f15f-4b57-a963-9160fa83d15b for instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 on hv-cinder-78364 Oct 28 15:58:33.767800 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-33d773c6-bee5-4cfe-bca2-c2bf766056dd req-a0f0fc8c-d82a-4a48-8ca2-8d89485525fb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037686 Oct 28 15:58:33.768416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1041/2049] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:58:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:58:34.393281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:34.394039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:34.400787 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:34.401224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:34.402543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:34.402974 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:34.419387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:34.420680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:34.427123 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:34.429090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:34.429090 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:34.429809 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:34.436516 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:34.437056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:34.437640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lazy-loading 'fault' on Instance uuid ecfea674-92fa-46b4-9ea8-ed35e5f207b5 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:58:34.487660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:34.495598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0ff18e5f-1ae2-4eb2-8279-72b1a19817c8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 200 len: 1229 microversion: 2.1 time: 0.106410 Oct 28 15:58:34.500427 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1009/2050] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:34 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:34.505478 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-880b6028-ca13-40d6-968b-a533dc9deb7f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.090997 Oct 28 15:58:34.506126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1042/2051] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:34 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:35.513481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:35.514113 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:35.517699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:35.518740 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:35.520693 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:35.521503 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:35.521954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:35.522386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:35.527747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:35.527747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:35.527936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:35.528209 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:35.538126 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] HTTP exception thrown: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. Oct 28 15:58:35.538727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Returning 404 to user: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:58:35.539621 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c5ef7ac8-06d9-45c5-b013-6094c78a2fd2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 404 len: 111 microversion: 2.1 time: 0.030414 Oct 28 15:58:35.540156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1010/2052] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:35 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 15:58:35.587402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-87b7e6e6-7a5b-476e-a461-d8476b2678ea tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.073419 Oct 28 15:58:35.588058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1043/2053] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:35 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:35.634908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1300848560", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-378413968", "security_groups": [{"name": "tempest-secgroup-smoke-535222416"}], "block_device_mapping_v2": [{"uuid": "d187b3c6-6c3b-4f33-be21-f02049f02040", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dd7a3f1-3fb7-4481-b947-a81baecf62e5"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:35.729550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] validate_networks() for [('3dd7a3f1-3fb7-4481-b947-a81baecf62e5', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 15:58:36.085705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 15:58:36.086132 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 15:58:36.086624 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 15:58:36.087036 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 15:58:36.087448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 15:58:36.096145 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:36.096650 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:36.097431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:36.097858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:36.113970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 15:58:36.118064 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for user 0ad9a2338a304b39a34043a140a6a367 and project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 15:58:36.172536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 15:58:36.174722 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d187b3c6-6c3b-4f33-be21-f02049f02040',volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 15:58:36.599524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:36.600334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-aa6f2418-8440-49f8-ab1c-62d1ac0efd8b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.969036 Oct 28 15:58:36.600994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1011/2054] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 15:58:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 15:58:36.601785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:36.609454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:36.609900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:36.610696 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:36.611121 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:36.611306 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-56e34f09-5499-47c0-902d-ba5520f3605d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:36.611918 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-56e34f09-5499-47c0-902d-ba5520f3605d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:36.663994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-56e34f09-5499-47c0-902d-ba5520f3605d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:36.671310 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-56e34f09-5499-47c0-902d-ba5520f3605d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1094 microversion: 2.1 time: 0.063756 Oct 28 15:58:36.672075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1012/2055] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:36 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:36.672779 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b661190c-4227-42eb-bac9-92f94c13b5b3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.077037 Oct 28 15:58:36.673542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1044/2056] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:36 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:37.683557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:37.684600 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:37.687491 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:37.688190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:37.691367 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:37.691813 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:37.692613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:37.693059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:37.695289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:37.695727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:37.696531 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:37.696965 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:37.758490 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:37.766747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fb37ea71-ce18-4c0d-a9ad-ca1ded5ff2ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1136 microversion: 2.1 time: 0.083409 Oct 28 15:58:37.767515 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1045/2057] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:37 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:37.770888 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0853e5c3-aa0e-43b8-b16f-e58c545b56d0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.090428 Oct 28 15:58:37.775537 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1013/2058] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:37 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:38.784426 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:38.786053 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:38.786546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:38.787615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:38.792645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:38.796349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:38.796349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:38.796564 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:38.796659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:38.796759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:38.796759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:38.796759 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:38.859044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:38.861033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-131d6b96-9717-465b-b5ca-44ba9055d156 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.078532 Oct 28 15:58:38.862247 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1014/2059] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:38 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:38.866694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b097cfae-c9b9-4692-b4d7-98a6ce25e523 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1210 microversion: 2.1 time: 0.086221 Oct 28 15:58:38.871171 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1046/2060] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:38 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:39.873448 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:39.874546 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:39.881101 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:39.881549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:39.882554 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:39.883321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:39.888306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:39.889733 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:39.897653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:39.898102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:39.898874 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:39.899330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:39.967550 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-35856898-4d27-45e5-b2d1-32397de21f09 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.098614 Oct 28 15:58:39.968238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1015/2061] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:39 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:40.064759 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:40.072460 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a30a08dd-c83c-4c3b-9e5a-e0cc4048bc8a tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.189486 Oct 28 15:58:40.073008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1047/2062] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:39 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:58:40.209199 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-6c3dabec-cf34-44ed-b3b5-2e1f091c3a0c req-0d64680b-aca0-431a-b55f-2d9eb8315213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa42a1d8-69f0-474f-bc4b-28f968884724", "tag": "4d937f17-5f48-4b5c-bbbd-e44c57308ea1"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:40.210894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:58:40.210894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:58:40.219444 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c3dabec-cf34-44ed-b3b5-2e1f091c3a0c req-0d64680b-aca0-431a-b55f-2d9eb8315213 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:40.219870 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6c3dabec-cf34-44ed-b3b5-2e1f091c3a0c req-0d64680b-aca0-431a-b55f-2d9eb8315213 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:40.236257 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-6c3dabec-cf34-44ed-b3b5-2e1f091c3a0c req-0d64680b-aca0-431a-b55f-2d9eb8315213 service nova] Creating event network-changed:4d937f17-5f48-4b5c-bbbd-e44c57308ea1 for instance aa42a1d8-69f0-474f-bc4b-28f968884724 on hv-cinder-78364 Oct 28 15:58:40.239665 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-6c3dabec-cf34-44ed-b3b5-2e1f091c3a0c req-0d64680b-aca0-431a-b55f-2d9eb8315213 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Oct 28 15:58:40.240250 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1016/2063] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:58:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:58:40.979242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:40.980105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:40.987578 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:40.988023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:40.989001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:40.989438 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:41.083596 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e01ece7d-1e15-4656-aabd-a9f9bd9cec66 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.108027 Oct 28 15:58:41.084247 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1048/2064] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:40 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:41.090078 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:41.093963 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:41.097545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:41.098025 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:41.098788 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:41.099217 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:41.218633 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:41.225763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a9fea7d7-f910-4e8c-babc-e29bc3bfa5ef tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.140213 Oct 28 15:58:41.226317 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1017/2065] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:41 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:58:42.095767 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:42.096789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:42.103567 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:42.104013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:42.104803 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:42.105237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:42.164960 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c2d5c338-5868-4c61-871a-5a583576d39e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.073165 Oct 28 15:58:42.165594 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1049/2066] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:42 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:42.242569 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:42.243171 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:42.250010 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:42.250453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:42.251208 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:42.251639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:42.365672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:42.373356 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6450a058-b852-461d-9400-2a788093a547 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.134409 Oct 28 15:58:42.373896 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1018/2067] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:42 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:43.177598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:43.178631 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:43.185533 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:43.186043 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:43.187172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:43.187934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:43.253105 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8f35719d-3ec0-4663-87fb-d1e85519dffc tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.079375 Oct 28 15:58:43.253734 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1050/2068] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:43 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:43.389705 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:43.390308 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:43.396543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:43.396988 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:43.397746 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:43.398177 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:43.740620 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:43.747968 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-41109c84-1ab3-48d0-8137-ae3b60cfe415 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.361918 Oct 28 15:58:43.748547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1019/2069] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:43 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:44.265727 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:44.266729 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:44.273931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:44.274375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:44.275154 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:44.275587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:44.336514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e96fa87-4372-41e6-9e60-239a748abe71 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.075145 Oct 28 15:58:44.337130 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1051/2070] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:44 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:44.764933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:44.765544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:44.771663 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:44.772166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:44.772969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:44.773392 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:44.888779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:44.895948 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-83ddc63d-fca9-4194-bc1a-ff062649e94f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.135381 Oct 28 15:58:44.896528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1020/2071] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:44 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:45.348344 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:45.349392 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:45.356554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:45.357016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:45.357765 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:45.358188 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:45.423613 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c1589442-d7e5-4fc5-97ce-74249ccf1d0c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.079104 Oct 28 15:58:45.430953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1052/2072] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:45 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:45.912840 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:45.913436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:45.919608 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:45.920053 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:45.920848 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:45.921281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:46.037700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:46.044862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-55b6571a-ec74-4365-8c5f-ad29ff0008d6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.135792 Oct 28 15:58:46.045425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1021/2073] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:45 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:46.435500 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:46.436501 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:46.443168 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:46.443606 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:46.444355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:46.444801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:46.506161 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-87454c5c-b9ed-4085-84f8-c7465c8417c5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.074502 Oct 28 15:58:46.506771 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1053/2074] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:46 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:47.060994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:47.061522 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:47.067773 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:47.068220 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:47.069018 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:47.069453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:47.190094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:47.197239 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-178b89fa-e20b-4855-be0f-9eb6c1127849 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.140521 Oct 28 15:58:47.197796 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1022/2075] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:47 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:47.518013 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:47.519016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:47.526936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:47.527380 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:47.528172 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:47.528635 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:47.603180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9b5448d-7838-4e4d-8995-e64a56e1dd5f tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.089061 Oct 28 15:58:47.603798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1054/2076] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:47 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:48.214087 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:48.214687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:48.220895 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:48.221336 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:48.222095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:48.222525 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:48.340309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:48.347576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f83cad69-b214-4ac0-95a5-ce082d5db3ec tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.137192 Oct 28 15:58:48.348127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1023/2077] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:48 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:48.615421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:48.616424 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:48.623091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:48.623527 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:48.624270 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:48.624721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:48.683112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-32e6b4db-973a-4f7d-83bf-ccb109f6af82 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.071536 Oct 28 15:58:48.683736 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1055/2078] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:48 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:49.364543 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:49.365059 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:49.371393 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:49.372019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:49.372802 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:49.373232 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:49.495691 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:49.502915 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-1d533cf6-3d8b-4932-b6ba-b341161740f3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.142157 Oct 28 15:58:49.503479 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1024/2079] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:49 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:49.695280 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:49.696284 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:49.703542 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:49.703988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:49.704795 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:49.705226 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:49.764699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e31030a7-a3c3-497d-a5d5-2a084facf629 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28763 microversion: 2.1 time: 0.073233 Oct 28 15:58:49.765349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1056/2080] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:49 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28763 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:50.519474 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:50.519975 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:50.526273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:50.526718 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:50.527475 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:50.527905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:50.647556 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:50.655168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b34340d1-9eae-45dd-84f0-59d2939f8e1e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.139514 Oct 28 15:58:50.655727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1025/2081] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:50 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:50.784720 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:50.785640 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:50.792318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:50.792785 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:50.794151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:50.794582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:50.972180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-4e1a95fa-1e3c-47bb-adb8-345941c60c83 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 28795 microversion: 2.1 time: 0.191642 Oct 28 15:58:50.973641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1057/2082] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:50 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 28795 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:51.672614 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:51.673309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:51.680131 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:51.685725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:51.685725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:51.685725 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:51.806396 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:51.814266 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bc5bba5d-8051-4381-8d07-4549ce17b65f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.145920 Oct 28 15:58:51.814845 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1026/2083] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:51 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:51.944712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-a2c4378a-ecd8-4f12-bec0-b76e5d4ef4cf req-d70321ab-5dcc-4af1-a19b-9674b920b643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa42a1d8-69f0-474f-bc4b-28f968884724", "name": "network-vif-plugged", "status": "completed", "tag": "4d937f17-5f48-4b5c-bbbd-e44c57308ea1"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:51.946225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:58:51.946225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:58:51.954468 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-a2c4378a-ecd8-4f12-bec0-b76e5d4ef4cf req-d70321ab-5dcc-4af1-a19b-9674b920b643 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:51.954901 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-a2c4378a-ecd8-4f12-bec0-b76e5d4ef4cf req-d70321ab-5dcc-4af1-a19b-9674b920b643 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:51.965293 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-a2c4378a-ecd8-4f12-bec0-b76e5d4ef4cf req-d70321ab-5dcc-4af1-a19b-9674b920b643 service nova] Creating event network-vif-plugged:4d937f17-5f48-4b5c-bbbd-e44c57308ea1 for instance aa42a1d8-69f0-474f-bc4b-28f968884724 on hv-cinder-78364 Oct 28 15:58:51.970710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-a2c4378a-ecd8-4f12-bec0-b76e5d4ef4cf req-d70321ab-5dcc-4af1-a19b-9674b920b643 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 Oct 28 15:58:51.971354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1058/2084] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:58:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:58:51.985383 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:51.986235 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:51.992458 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:51.992901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:51.993793 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:51.994323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:52.078982 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a4b4a271-23e7-4778-b0e2-005813e7ba34 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 30842 microversion: 2.1 time: 0.097680 Oct 28 15:58:52.079909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1027/2085] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:51 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 30842 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:52.831845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:52.832621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:52.838607 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:52.839044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:52.839792 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:52.840220 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:52.960791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:52.968541 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-37f51d65-919e-4ba5-9b3b-bfe952599bae tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.141153 Oct 28 15:58:52.969111 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1059/2086] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:52 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:53.091932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:53.092900 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:53.099671 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:53.100116 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:53.100925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:53.101355 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:53.196151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-843b1820-a720-477e-80aa-b8c0b1b5531a tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 32622 microversion: 2.1 time: 0.108786 Oct 28 15:58:53.196805 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1028/2087] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:53 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 32622 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:53.985747 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:53.986402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:53.992586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:53.993032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:53.993794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:53.994233 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:54.119451 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:54.126878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-22edc4b3-2d8d-4415-9903-56beb98c60f6 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1265 microversion: 2.1 time: 0.145431 Oct 28 15:58:54.127483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1060/2088] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:53 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:54.208198 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:54.209270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:54.215989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:54.217094 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:54.217858 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:54.218290 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:54.299471 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-875e6618-c9f0-4b18-93b1-27a639d52eb5 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 33513 microversion: 2.1 time: 0.095226 Oct 28 15:58:54.300046 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1029/2089] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:54 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 33513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:55.142966 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:55.143474 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:55.149554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.150017 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.150754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.151176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.275789 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:55.283805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f9b3c469-d23f-4ea7-bbac-503108118271 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1451 microversion: 2.1 time: 0.144623 Oct 28 15:58:55.284362 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1061/2090] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:55 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:55.300856 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:58:55.301584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:55.312162 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:55.313198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:55.314411 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.314872 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.315676 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.316107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.319027 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.319556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.320215 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:55.326705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:55.413439 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-97a0493f-9dfd-4985-8a4f-1df3c719ded2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 34461 microversion: 2.1 time: 0.104747 Oct 28 15:58:55.415881 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1062/2091] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:55 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 34461 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 15:58:55.444790 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:58:55.451966 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0b74edea-c461-4ac1-9207-abc6400ba85b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1451 microversion: 2.1 time: 0.155329 Oct 28 15:58:55.452544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1030/2092] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:58:55 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:58:56.426329 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:56.427319 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:56.434191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:56.434625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:56.436014 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:56.436453 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:56.522954 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f4e11b64-f06f-4a41-9a2c-42afa1518762 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 35553 microversion: 2.1 time: 0.100602 Oct 28 15:58:56.523625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1063/2093] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:56 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 35553 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:57.404370 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-52c062c1-7626-4de7-ade2-7d06d6333f45 req-d67c69da-a707-4dd5-a396-8a045b03f26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa42a1d8-69f0-474f-bc4b-28f968884724", "tag": "4d937f17-5f48-4b5c-bbbd-e44c57308ea1"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:57.406006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:58:57.406006 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 15:58:57.413618 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-52c062c1-7626-4de7-ade2-7d06d6333f45 req-d67c69da-a707-4dd5-a396-8a045b03f26e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:57.413970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-52c062c1-7626-4de7-ade2-7d06d6333f45 req-d67c69da-a707-4dd5-a396-8a045b03f26e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:57.424794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-52c062c1-7626-4de7-ade2-7d06d6333f45 req-d67c69da-a707-4dd5-a396-8a045b03f26e service nova] Creating event network-changed:4d937f17-5f48-4b5c-bbbd-e44c57308ea1 for instance aa42a1d8-69f0-474f-bc4b-28f968884724 on hv-cinder-78364 Oct 28 15:58:57.429585 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-52c062c1-7626-4de7-ade2-7d06d6333f45 req-d67c69da-a707-4dd5-a396-8a045b03f26e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028931 Oct 28 15:58:57.430397 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1031/2094] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:58:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:58:57.536559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:57.539477 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:57.546588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:57.547041 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:57.547936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:57.548366 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:57.648061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c7fb3587-dd73-47f2-bda9-3a1b5def7b50 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 37025 microversion: 2.1 time: 0.115722 Oct 28 15:58:57.649008 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1064/2095] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:57 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 37025 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:58.661925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:58.662940 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:58.669003 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:58.669450 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:58.670209 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:58.670641 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:58.752517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-74986d49-a1ef-448d-8edc-a971d9b24bec tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 38289 microversion: 2.1 time: 0.095058 Oct 28 15:58:58.753194 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1032/2096] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:58 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 38289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:58:59.764210 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:58:59.765238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:58:59.772074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:59.772550 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:59.773304 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:58:59.773732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:58:59.835411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a5fad8f2-6272-44d6-bffb-bf109d0157e0 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 38289 microversion: 2.1 time: 0.075096 Oct 28 15:58:59.836258 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1065/2097] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:58:59 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 38289 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:59:00.847719 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:00.848736 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:00.855467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:00.855905 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:00.857202 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:00.857646 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:00.924340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-646b764e-9fd5-47e2-b271-95e6bf0c7ace tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 38289 microversion: 2.1 time: 0.080490 Oct 28 15:59:00.924987 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1033/2098] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:59:00 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 38289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:59:01.938094 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:01.939169 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:01.945985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:01.946425 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:01.947170 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:01.947699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:02.008892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-65361def-c99b-44b6-9046-95d9eb76f3c4 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 38289 microversion: 2.1 time: 0.075683 Oct 28 15:59:02.009502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1066/2099] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:59:01 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 38289 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:59:03.021967 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:03.022874 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:03.030645 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:03.031082 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:03.031833 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:03.032547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:03.103230 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c462b604-738c-4fac-981c-e33af2275e36 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action" status: 200 len: 38420 microversion: 2.1 time: 0.085314 Oct 28 15:59:03.103873 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1034/2100] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Oct 28 15:59:03 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/action => generated 38420 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 15:59:03.113900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:03.114464 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:03.121224 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:03.121661 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:03.122404 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:03.122828 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:03.145994 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f2f4301f-e9a3-43ff-8494-a114f40ee6a8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/ips" status: 200 len: 147 microversion: 2.1 time: 0.035991 Oct 28 15:59:03.146555 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1067/2101] 10.222.0.86 () {58 vars in 1247 bytes} [Thu Oct 28 15:59:03 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:04.765031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0adef553-0180-4c9c-8038-51a76901cd28"}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:04.766188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:04.773004 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:04.776172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:04.776172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:04.776172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:05.399328 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9138f01d-5f08-4358-9100-904812fbba08 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.638929 Oct 28 15:59:05.399859 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1035/2102] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:59:04 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:12.848507 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:12.849411 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:12.855649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:12.856084 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:12.856865 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:12.857291 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:12.886175 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-7d9a8016-9ab6-4f61-8567-58fc75357867 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041570 Oct 28 15:59:12.886712 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1068/2103] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:59:12 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:12.897205 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:12.897816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:12.906229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:12.906679 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:12.907477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:12.908173 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:12.935903 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bafb6dba-8283-4f76-9868-677c90132c96 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28" status: 200 len: 194 microversion: 2.1 time: 0.043292 Oct 28 15:59:12.936507 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1036/2104] 10.222.0.86 () {58 vars in 1412 bytes} [Thu Oct 28 15:59:12 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:14.506838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a02418b4-4bf5-4fca-99be-0b177234be97"}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:14.507887 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:14.514049 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:14.514604 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:14.515375 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:14.515799 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:15.256912 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-560647a5-aa13-45ce-9d0e-5c36cf0be8f3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753495 Oct 28 15:59:15.257506 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1069/2105] 10.222.0.86 () {60 vars in 1322 bytes} [Thu Oct 28 15:59:14 2021] POST /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:23.766496 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:23.767416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:23.773632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:23.774079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:23.774846 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:23.775278 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:23.804950 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c6ff20bb-c091-4830-b09a-515cfbe334e8 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042282 Oct 28 15:59:23.805489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1037/2106] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:59:23 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:24.032307 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:24.032941 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:24.039930 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:24.040988 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:24.041755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:24.042187 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:24.070118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ba149f4f-18fa-49d9-931b-3be092dcfb63 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28" status: 200 len: 194 microversion: 2.1 time: 0.042540 Oct 28 15:59:24.070698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1070/2107] 10.222.0.86 () {58 vars in 1412 bytes} [Thu Oct 28 15:59:24 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:24.079879 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:24.080376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:24.086630 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:24.087074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:24.087837 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:24.088271 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:24.163969 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lazy-loading 'services' on Instance uuid fd314ce5-d7eb-411d-b1b1-c972d8e65052 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:59:24.366809 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-abde5cb2-03d4-4993-8d49-c91e9749ad68 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28" status: 202 len: 0 microversion: 2.1 time: 0.290419 Oct 28 15:59:24.367557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1038/2108] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:59:24 2021] DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/0adef553-0180-4c9c-8038-51a76901cd28 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:59:26.518125 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:26.518637 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:26.525472 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:26.525911 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:26.526662 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:26.527089 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:26.554184 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-604258b1-8ce1-42e4-bfb5-8e08ae99cd9e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/a02418b4-4bf5-4fca-99be-0b177234be97" status: 200 len: 194 microversion: 2.1 time: 0.039809 Oct 28 15:59:26.554745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1071/2109] 10.222.0.86 () {58 vars in 1412 bytes} [Thu Oct 28 15:59:26 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/a02418b4-4bf5-4fca-99be-0b177234be97 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 15:59:26.564954 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:26.565560 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:26.572073 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:26.572552 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:26.573309 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:26.573735 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:26.650123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lazy-loading 'services' on Instance uuid fd314ce5-d7eb-411d-b1b1-c972d8e65052 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:59:26.886323 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-dd703847-13c0-4338-bdfa-ae3353a81f60 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/a02418b4-4bf5-4fca-99be-0b177234be97" status: 202 len: 0 microversion: 2.1 time: 0.325643 Oct 28 15:59:26.886891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1039/2110] 10.222.0.86 () {58 vars in 1415 bytes} [Thu Oct 28 15:59:26 2021] DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments/a02418b4-4bf5-4fca-99be-0b177234be97 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 15:59:28.041286 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:28.042254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:28.048625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.050990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.050990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.050990 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.079056 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d28efbef-cfb8-47d1-94c9-6eda69de737d tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041431 Oct 28 15:59:28.079605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1072/2111] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:59:28 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:59:28.179375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:28.180374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:28.186283 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.186715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.187464 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.187886 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.214830 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-07ccdf18-fdd7-43b6-a7dc-78d6431360a9 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040735 Oct 28 15:59:28.215365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1040/2112] 10.222.0.86 () {58 vars in 1301 bytes} [Thu Oct 28 15:59:28 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 15:59:28.268429 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:28.268925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:28.275110 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.275547 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.276294 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.276745 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.301037 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 15:59:28.567529 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c77919bd-8179-4e2c-b542-7c159f4f7768 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 204 len: 0 microversion: 2.1 time: 0.302321 Oct 28 15:59:28.568058 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1073/2113] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:59:28 2021] DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 15:59:28.576156 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:28.577589 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:28.582799 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.583316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.584637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:28.585074 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:28.703073 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:59:28.710944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-24a86adf-0dbc-4bf5-bfc7-50907925a386 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1675 microversion: 2.1 time: 0.138582 Oct 28 15:59:28.711493 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1041/2114] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:28 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:59:29.727945 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:29.728698 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:29.735260 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:29.735704 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:29.736502 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:29.736935 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:29.867143 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:59:29.874432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-986f9c6a-deaf-44b9-8670-c57158e1bfe2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1675 microversion: 2.1 time: 0.150591 Oct 28 15:59:29.875191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1074/2115] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:29 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:59:30.891891 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:30.892518 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:30.898758 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:30.899200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:30.899957 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:30.900384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:31.020111 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:59:31.027340 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-7d77aa27-cfa1-421c-9d07-3e14fd4c99f2 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1675 microversion: 2.1 time: 0.139140 Oct 28 15:59:31.037853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1042/2116] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:30 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 15:59:31.607666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-802979c9-6add-44bc-b365-4e25d33ed8cc req-74bc7239-d8e9-46fd-a3b8-5ce1ba4cb2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd314ce5-d7eb-411d-b1b1-c972d8e65052", "name": "network-vif-deleted", "tag": "915bfb20-89e8-43b4-bdbe-8b05ff02b595"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 15:59:31.609241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 15:59:31.609241 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 15:59:31.617113 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-802979c9-6add-44bc-b365-4e25d33ed8cc req-74bc7239-d8e9-46fd-a3b8-5ce1ba4cb2fc service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:31.617546 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-802979c9-6add-44bc-b365-4e25d33ed8cc req-74bc7239-d8e9-46fd-a3b8-5ce1ba4cb2fc service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:31.628679 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-802979c9-6add-44bc-b365-4e25d33ed8cc req-74bc7239-d8e9-46fd-a3b8-5ce1ba4cb2fc service nova] Creating event network-vif-deleted:915bfb20-89e8-43b4-bdbe-8b05ff02b595 for instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 on hv-cinder-78364 Oct 28 15:59:31.633666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-802979c9-6add-44bc-b365-4e25d33ed8cc req-74bc7239-d8e9-46fd-a3b8-5ce1ba4cb2fc service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Oct 28 15:59:31.634349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1075/2117] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 15:59:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 15:59:32.045190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:32.045801 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:32.051944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:32.052933 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:32.053694 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:32.054123 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:32.085107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:32.085465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:32.085908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lazy-loading 'fault' on Instance uuid fd314ce5-d7eb-411d-b1b1-c972d8e65052 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 15:59:32.124512 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d3253cf02e4686821689ba7abbb7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1888a1cbda247d0897d7f5c5a80a8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 15:59:32.132261 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b6fd12bc-59bb-413e-acc0-3307ddf7aed3 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 200 len: 1328 microversion: 2.1 time: 0.090708 Oct 28 15:59:32.132850 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1043/2118] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:32 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 15:59:33.149797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:33.150448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:33.156851 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:33.157289 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:33.158048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:33.158732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:33.171835 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. Oct 28 15:59:33.172432 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:59:33.173234 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-535fc1a1-47c9-4c54-adee-f550e489698e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 404 len: 111 microversion: 2.1 time: 0.027574 Oct 28 15:59:33.173753 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1076/2119] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:33 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:59:33.182334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-66d2c71a-070f-4a61-a674-b9d20a16555b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '.version_select at 0x7fdc1807e040>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:33.265532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-66d2c71a-070f-4a61-a674-b9d20a16555b tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801255468" status: 202 len: 0 microversion: 2.1 time: 0.086766 Oct 28 15:59:33.266079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1044/2120] 10.222.0.86 () {58 vars in 1220 bytes} [Thu Oct 28 15:59:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801255468 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 15:59:36.494845 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:36.495318 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:36.501484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:36.501929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:36.502678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:36.503104 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:36.515790 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. Oct 28 15:59:36.516367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:59:36.517182 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f15797c5-3a56-43a0-bb11-1053fd6d9390 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 404 len: 111 microversion: 2.1 time: 0.026000 Oct 28 15:59:36.517685 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1077/2121] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:59:36 2021] DELETE /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:59:36.526237 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:36.526851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: fd314ce5-d7eb-411d-b1b1-c972d8e65052] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:36.532640 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:36.533089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:36.534108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:36.534540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:36.548061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. Oct 28 15:59:36.548674 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance fd314ce5-d7eb-411d-b1b1-c972d8e65052 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:59:36.549485 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cc26e3be-f2c7-4e5e-85e6-a62c8f22836e tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052" status: 404 len: 111 microversion: 2.1 time: 0.027436 Oct 28 15:59:36.550153 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1045/2122] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:36 2021] GET /compute/v2.1/servers/fd314ce5-d7eb-411d-b1b1-c972d8e65052 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:59:37.815665 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:37.816160 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:37.822880 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:37.824268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:37.824268 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:37.824495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:37.837885 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. Oct 28 15:59:37.838459 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:59:37.839316 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b3636a71-05a1-42ad-82f6-3abb1664884c tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 404 len: 111 microversion: 2.1 time: 0.027333 Oct 28 15:59:37.839821 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1078/2123] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 15:59:37 2021] DELETE /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:59:37.847346 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 15:59:37.847949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] [instance: 882e73f1-1371-4b7f-a683-76e5c9c6a07b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 15:59:37.854170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:37.854613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:37.855371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 15:59:37.855797 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 15:59:37.868581 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] HTTP exception thrown: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. Oct 28 15:59:37.869151 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] Returning 404 to user: Instance 882e73f1-1371-4b7f-a683-76e5c9c6a07b could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 15:59:37.869944 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6a381ab6-f71c-476d-9007-b5b7b989d040 tempest-AttachVolumeTestJSON-1347311365 tempest-AttachVolumeTestJSON-1347311365-project] 10.222.0.86 "GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b" status: 404 len: 111 microversion: 2.1 time: 0.026283 Oct 28 15:59:37.870456 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1046/2124] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 15:59:37 2021] GET /compute/v2.1/servers/882e73f1-1371-4b7f-a683-76e5c9c6a07b => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 15:59:43.448573 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 15:59:43.449083 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 15:59:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:00:51.430396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-228570139", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "595c9c4c-5aee-4154-98db-1347261cc868"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:00:51.630787 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] validate_networks() for [('595c9c4c-5aee-4154-98db-1347261cc868', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 16:00:52.016598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 16:00:52.017018 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 16:00:52.017514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 16:00:52.017914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 16:00:52.018322 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 16:00:52.028168 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:52.028643 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:52.029430 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:52.029857 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:52.045976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Getting quotas for project 90c39d86c23b4d46855dca8657c1356d. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 16:00:52.049849 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Getting quotas for user 3e60eeea68db414e9c9789632766d68d and project 90c39d86c23b4d46855dca8657c1356d. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 16:00:52.060804 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 16:00:52.063091 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 16:00:52.213396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-edca2a51-1c85-4ea7-bfbb-71f220f89854 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787409 Oct 28 16:00:52.213949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1079/2125] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 16:00:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 16:00:52.224712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ef23b3c0-f080-4d7d-9529-0f020d504e9b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:52.225325 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ef23b3c0-f080-4d7d-9529-0f020d504e9b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:52.327190 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ef23b3c0-f080-4d7d-9529-0f020d504e9b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:52.333926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ef23b3c0-f080-4d7d-9529-0f020d504e9b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1213 microversion: 2.1 time: 0.113839 Oct 28 16:00:52.334477 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1047/2126] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:52 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:53.351808 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:53.352338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:53.358769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:53.359218 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:53.359978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:53.360480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:53.423452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:53.430862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-01a0f0bd-404d-4ee1-be96-2038e1708954 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1217 microversion: 2.1 time: 0.083516 Oct 28 16:00:53.431420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1080/2127] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:53 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:54.448828 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:54.449433 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:54.455682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:54.456122 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:54.456908 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:54.457390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:54.517637 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:54.524994 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d01a04d6-a05b-4a35-b435-9336d5e48b26 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1273 microversion: 2.1 time: 0.080453 Oct 28 16:00:54.525555 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1048/2128] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:54 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:55.542540 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:55.543066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:55.549204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:55.549647 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:55.550407 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:55.550836 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:55.668402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:55.675587 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-6b54aeb9-12e3-43b2-9103-a83e683c10f1 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.137305 Oct 28 16:00:55.676149 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1081/2129] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:55 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:56.061188 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-0b93ffe8-698f-480a-9f3f-ac578e626e41 req-ca200ec7-d943-442e-ab1a-b826b124a7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9bd2e72-b761-48dc-851a-fb1f855da86b", "tag": "8e02839b-2d92-4fbb-8435-f49e7ddd3ea8"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:00:56.062715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:00:56.062715 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:00:56.069338 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-0b93ffe8-698f-480a-9f3f-ac578e626e41 req-ca200ec7-d943-442e-ab1a-b826b124a7c9 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:56.069776 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-0b93ffe8-698f-480a-9f3f-ac578e626e41 req-ca200ec7-d943-442e-ab1a-b826b124a7c9 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:56.080489 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-0b93ffe8-698f-480a-9f3f-ac578e626e41 req-ca200ec7-d943-442e-ab1a-b826b124a7c9 service nova] Creating event network-changed:8e02839b-2d92-4fbb-8435-f49e7ddd3ea8 for instance a9bd2e72-b761-48dc-851a-fb1f855da86b on hv-cinder-78364 Oct 28 16:00:56.085423 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-0b93ffe8-698f-480a-9f3f-ac578e626e41 req-ca200ec7-d943-442e-ab1a-b826b124a7c9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085374 Oct 28 16:00:56.086008 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1049/2130] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:00:56.692228 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:56.692871 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:56.699071 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:56.699512 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:56.700269 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:56.700725 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:56.821686 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:56.828732 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d827e4da-8358-4715-876c-db155f3aae7b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.140209 Oct 28 16:00:56.829287 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1082/2131] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:56 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:57.846573 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:57.847268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:57.853632 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:57.854076 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:57.854829 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:57.855260 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:57.976770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:57.983959 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-866754a3-47bb-464f-80e8-b6806c044308 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.141866 Oct 28 16:00:57.984606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1050/2132] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:57 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:00:59.000840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:00:59.001357 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:00:59.007499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:59.007931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:59.008695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:00:59.009114 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:00:59.127433 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:00:59.134499 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-78a64a27-7bde-4404-b39d-5f5722d4029b tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.137489 Oct 28 16:00:59.135057 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1083/2133] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:00:58 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:00.150794 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:00.151398 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:00.157723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:00.158161 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:00.158926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:00.159347 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:00.280174 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:00.287606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-2ea10d43-38d8-4161-a733-86c03eb908ff tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.140489 Oct 28 16:01:00.288425 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1051/2134] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:00 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:01.304488 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:01.305098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:01.311288 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:01.311758 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:01.312537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:01.312959 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:01.433211 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:01.440208 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d460bf00-5c6a-4242-890e-92b4ce42b8cc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.139411 Oct 28 16:01:01.440784 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1084/2135] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:01 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:02.432582 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-42fbaa62-86b1-4f0b-8da7-ce5c5d8f89ed req-85d29797-488c-4686-8917-f1333d5fa3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bd2e72-b761-48dc-851a-fb1f855da86b", "name": "network-vif-plugged", "status": "completed", "tag": "8e02839b-2d92-4fbb-8435-f49e7ddd3ea8"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:02.433498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:02.433498 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:01:02.440216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-42fbaa62-86b1-4f0b-8da7-ce5c5d8f89ed req-85d29797-488c-4686-8917-f1333d5fa3a4 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:02.440686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-42fbaa62-86b1-4f0b-8da7-ce5c5d8f89ed req-85d29797-488c-4686-8917-f1333d5fa3a4 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:02.454254 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-42fbaa62-86b1-4f0b-8da7-ce5c5d8f89ed req-85d29797-488c-4686-8917-f1333d5fa3a4 service nova] Creating event network-vif-plugged:8e02839b-2d92-4fbb-8435-f49e7ddd3ea8 for instance a9bd2e72-b761-48dc-851a-fb1f855da86b on hv-cinder-78364 Oct 28 16:01:02.463145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:02.463145 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:02.463727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-42fbaa62-86b1-4f0b-8da7-ce5c5d8f89ed req-85d29797-488c-4686-8917-f1333d5fa3a4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096875 Oct 28 16:01:02.463727 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1052/2136] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:02.467216 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:02.467663 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:02.468629 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:02.469221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:02.610283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:02.617588 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-fcb1eb09-a32d-4748-9514-d709f26ffc96 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.163645 Oct 28 16:01:02.620176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1085/2137] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:02 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:01:03.635938 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:03.637272 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:03.643568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:03.644013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:03.644822 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:03.645248 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:03.768056 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:03.775381 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-984fb472-00d8-4570-a78c-52bf5f9fb8ab tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.143835 Oct 28 16:01:03.775925 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1053/2138] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:03 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:04.792877 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:04.793710 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:04.800973 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:04.801416 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:04.802272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:04.802786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:04.932791 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:04.940902 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cd5a98c4-9492-4c34-9cab-6f9bc9ac2f52 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.151633 Oct 28 16:01:04.941678 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1086/2139] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:04 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:05.957233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:05.957835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:05.964083 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:05.965057 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:05.965814 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:05.966238 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:06.084765 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:06.092469 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-cb810e3f-36d6-4a23-b0bc-bf03afef5fb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.138883 Oct 28 16:01:06.093019 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1054/2140] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:05 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:07.108693 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:07.109290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:07.115381 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:07.115848 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:07.116625 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:07.117046 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:07.233112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:07.240129 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-aa0958cf-2de2-4efb-aa49-81b7316699ed tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.135077 Oct 28 16:01:07.240717 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1087/2141] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:07 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:08.256204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:08.256826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:08.263532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:08.263970 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:08.264749 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:08.265172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:08.397755 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:08.406616 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c93eb77d-1352-4f38-b353-ea06c1fa93e8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1313 microversion: 2.1 time: 0.153860 Oct 28 16:01:08.407601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1055/2142] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:08 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:09.423976 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:09.424708 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:09.430860 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:09.431301 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:09.432055 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:09.432667 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:09.553377 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:09.560644 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-c7e097a8-ad12-4544-aaa1-b2e3b14d9bb7 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1497 microversion: 2.1 time: 0.140231 Oct 28 16:01:09.561140 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1088/2143] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:09 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:13.030434 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:13.030909 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:13.036973 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:13.037685 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:13.038431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:13.038853 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:13.062989 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 16:01:13.378043 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-bef9dcaa-5499-4e63-8a11-b315a1f533d9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 204 len: 0 microversion: 2.1 time: 0.351507 Oct 28 16:01:13.378535 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1056/2144] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 16:01:13 2021] DELETE /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 16:01:13.386442 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:13.390456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:13.393534 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:13.393981 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:13.394737 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:13.395204 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:13.512817 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:13.519933 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-da027661-85d7-489b-acee-635d3f8c7dcc tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1503 microversion: 2.1 time: 0.137127 Oct 28 16:01:13.520505 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1089/2145] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:13 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1503 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:14.538375 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:14.539068 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:14.545826 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:14.546273 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:14.547031 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:14.547466 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:14.670079 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:14.677304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d4d21a47-607e-4186-b299-518078c57912 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1503 microversion: 2.1 time: 0.143286 Oct 28 16:01:14.677860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1057/2146] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:14 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:15.693957 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:15.694592 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:15.700838 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:15.701282 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:15.702044 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:15.702469 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:15.832082 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:15.840707 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1f5bfd07-a701-4818-815c-82256df68bad tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1503 microversion: 2.1 time: 0.150173 Oct 28 16:01:15.841177 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1090/2147] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:15 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:16.088971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1475247872", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-378413968", "security_groups": [{"name": "tempest-secgroup-smoke-535222416"}], "block_device_mapping_v2": [{"uuid": "cb5f7aff-2f06-4347-916b-acb82f0b7562", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dd7a3f1-3fb7-4481-b947-a81baecf62e5"}]}} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:16.187146 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.network.neutron [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] validate_networks() for [('3dd7a3f1-3fb7-4481-b947-a81baecf62e5', None, None, None, None, None)] {{(pid=116432) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 16:01:16.613723 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-f211b08d-3245-455a-bbc4-7f647a1ddcd8 req-54e65326-7140-493b-adf1-38bf1000ba97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bd2e72-b761-48dc-851a-fb1f855da86b", "name": "network-vif-deleted", "tag": "8e02839b-2d92-4fbb-8435-f49e7ddd3ea8"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:16.616580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:16.616580 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:01:16.626099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f211b08d-3245-455a-bbc4-7f647a1ddcd8 req-54e65326-7140-493b-adf1-38bf1000ba97 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.627562 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f211b08d-3245-455a-bbc4-7f647a1ddcd8 req-54e65326-7140-493b-adf1-38bf1000ba97 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.632421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 16:01:16.632976 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image limits 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 16:01:16.633568 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Flavor pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 16:01:16.634294 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Image pref 0:0:0 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 16:01:16.634792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.virt.hardware [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 16:01:16.640306 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-f211b08d-3245-455a-bbc4-7f647a1ddcd8 req-54e65326-7140-493b-adf1-38bf1000ba97 service nova] Creating event network-vif-deleted:8e02839b-2d92-4fbb-8435-f49e7ddd3ea8 for instance a9bd2e72-b761-48dc-851a-fb1f855da86b on hv-cinder-78364 Oct 28 16:01:16.645071 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.645523 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.645794 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-f211b08d-3245-455a-bbc4-7f647a1ddcd8 req-54e65326-7140-493b-adf1-38bf1000ba97 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 Oct 28 16:01:16.646330 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.646901 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.647023 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1091/2148] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:16.664863 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 16:01:16.669013 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.quota [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Getting quotas for user 0ad9a2338a304b39a34043a140a6a367 and project 9909723fa66c47a1a813ac7796204744. Resources: {'ram', 'cores', 'instances'} {{(pid=116432) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 16:01:16.725835 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Going to run 1 instances... {{(pid=116432) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 16:01:16.729553 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb5f7aff-2f06-4347-916b-acb82f0b7562',volume_size=None,volume_type=None)] {{(pid=116432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 16:01:16.859020 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:16.859705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:16.865523 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.865953 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.866695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.867112 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.901406 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:16.902409 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:16.902859 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.objects.instance [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lazy-loading 'fault' on Instance uuid a9bd2e72-b761-48dc-851a-fb1f855da86b {{(pid=116431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 16:01:16.943036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:16.949915 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-607a000d-27c6-4755-ac72-12e6799c5c1e tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 200 len: 1303 microversion: 2.1 time: 0.095936 Oct 28 16:01:16.950465 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1092/2149] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:16 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:01:17.213037 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-e0b53fa1-7e33-4573-b589-c65d147c312d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.127647 Oct 28 16:01:17.215657 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1058/2150] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 16:01:16 2021] POST /compute/v2.1/servers => generated 405 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 16:01:17.223669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-0ae436a6-956d-41a8-b1a8-a64ad1055578 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:17.224351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-0ae436a6-956d-41a8-b1a8-a64ad1055578 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:17.281126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-0ae436a6-956d-41a8-b1a8-a64ad1055578 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:17.287866 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-0ae436a6-956d-41a8-b1a8-a64ad1055578 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1094 microversion: 2.1 time: 0.067458 Oct 28 16:01:17.288355 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1093/2151] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:17 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:17.966881 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:17.967481 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: a9bd2e72-b761-48dc-851a-fb1f855da86b] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:17.974405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:17.974852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:17.975876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:17.976321 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:17.989721 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] HTTP exception thrown: Instance a9bd2e72-b761-48dc-851a-fb1f855da86b could not be found. Oct 28 16:01:17.990313 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Returning 404 to user: Instance a9bd2e72-b761-48dc-851a-fb1f855da86b could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:01:17.991127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f12c6b29-0eb1-4df0-ac05-911f24b8cb55 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b" status: 404 len: 111 microversion: 2.1 time: 0.028486 Oct 28 16:01:17.991644 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1059/2152] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:17 2021] GET /compute/v2.1/servers/a9bd2e72-b761-48dc-851a-fb1f855da86b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 16:01:18.046539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-674634875", "imageRef": "e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e", "flavorRef": "452", "networks": [{"uuid": "595c9c4c-5aee-4154-98db-1347261cc868"}]}} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:18.100276 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.network.neutron [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] validate_networks() for [('595c9c4c-5aee-4154-98db-1347261cc868', None, None, None, None, None)] {{(pid=116431) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 16:01:18.304369 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:18.305039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:18.311301 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:18.311942 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:18.312786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:18.313218 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:18.384949 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:18.392754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f8f4baf3-d225-4824-baec-8f8ee0ba9f59 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1144 microversion: 2.1 time: 0.092011 Oct 28 16:01:18.393316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1060/2153] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:18 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:01:18.467470 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Flavor limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 16:01:18.467900 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Image limits 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 16:01:18.468367 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Flavor pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 16:01:18.468811 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Image pref 0:0:0 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 16:01:18.469308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.virt.hardware [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 16:01:18.478283 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:18.478726 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:18.479879 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:18.480308 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:18.497010 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Getting quotas for project 90c39d86c23b4d46855dca8657c1356d. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 16:01:18.500937 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.quota [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Getting quotas for user 3e60eeea68db414e9c9789632766d68d and project 90c39d86c23b4d46855dca8657c1356d. Resources: {'ram', 'cores', 'instances'} {{(pid=116431) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 16:01:18.512102 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Going to run 1 instances... {{(pid=116431) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 16:01:18.514458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5baa0a5-80d1-466a-8cc8-88c36e6b2f4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 16:01:18.627694 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-1c0760ec-6784-434f-87aa-0a7f0fdb5820 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586094 Oct 28 16:01:18.628242 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1094/2154] 10.222.0.86 () {60 vars in 1146 bytes} [Thu Oct 28 16:01:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 16:01:18.638431 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-616d8101-ddf0-4e6f-b31d-a191999fe5df tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:18.639039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-616d8101-ddf0-4e6f-b31d-a191999fe5df tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:18.689342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-616d8101-ddf0-4e6f-b31d-a191999fe5df tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:18.695852 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-616d8101-ddf0-4e6f-b31d-a191999fe5df tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1213 microversion: 2.1 time: 0.061633 Oct 28 16:01:18.696416 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1061/2155] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:18 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:19.409731 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:19.411371 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:19.419225 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:19.419672 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:19.421001 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:19.421420 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:19.481949 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:19.490931 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-45b8363f-db5d-4b89-a61f-e79c355e2f62 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1192 microversion: 2.1 time: 0.086315 Oct 28 16:01:19.491494 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1095/2156] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:19 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:19.713714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:19.714394 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:19.720527 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:19.720971 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:19.721734 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:19.722172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:19.782932 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:19.790565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-d2199fa8-35d4-43b5-8d56-a23e7d3baeac tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1217 microversion: 2.1 time: 0.080703 Oct 28 16:01:19.791120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1062/2157] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:19 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:20.512909 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:20.513614 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:20.520191 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:20.520680 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:20.521460 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:20.521892 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:20.661626 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:20.669769 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bea03e35-be89-4a15-adb7-f1788a25cb7b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1277 microversion: 2.1 time: 0.161687 Oct 28 16:01:20.672610 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1096/2158] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:20 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:20.809365 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:20.810039 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:20.816268 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:20.821500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:20.821500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:20.821500 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:20.892334 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:20.899842 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b0ba878e-5e49-4e9d-b78c-1b9fbe47118d tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1271 microversion: 2.1 time: 0.094773 Oct 28 16:01:20.905399 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1063/2159] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:20 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:21.551098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-6e520c38-f3ce-49d4-835e-0e4d27a815a3 req-0c1f6561-eaa2-48d7-9200-ad5e6a090741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3856be1-712a-4d20-9dff-7a8c2b3b55ea", "tag": "54e381b5-364e-48b6-8ae8-1dc4b7287dcd"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:21.552152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:21.552152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:01:21.563956 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-6e520c38-f3ce-49d4-835e-0e4d27a815a3 req-0c1f6561-eaa2-48d7-9200-ad5e6a090741 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:21.564408 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-6e520c38-f3ce-49d4-835e-0e4d27a815a3 req-0c1f6561-eaa2-48d7-9200-ad5e6a090741 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:21.577934 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-6e520c38-f3ce-49d4-835e-0e4d27a815a3 req-0c1f6561-eaa2-48d7-9200-ad5e6a090741 service nova] Creating event network-changed:54e381b5-364e-48b6-8ae8-1dc4b7287dcd for instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea on hv-cinder-78364 Oct 28 16:01:21.584221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-6e520c38-f3ce-49d4-835e-0e4d27a815a3 req-0c1f6561-eaa2-48d7-9200-ad5e6a090741 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037400 Oct 28 16:01:21.585349 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1097/2160] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:21.686491 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:21.687418 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:21.693680 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:21.694231 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:21.695182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:21.695868 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:21.831714 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:21.844305 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-32ef89c9-3427-4919-80da-515d1d315772 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.158185 Oct 28 16:01:21.844631 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1064/2161] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:21 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:21.917414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:21.918151 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:21.924099 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:21.924579 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:21.925328 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:21.925764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:22.059352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:22.068913 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-8085189e-6a6e-4ec9-bdc6-c71c213152fb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.155350 Oct 28 16:01:22.072813 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1098/2162] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:21 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:22.860364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:22.860990 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:22.867289 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:22.867730 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:22.868510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:22.868939 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:22.990544 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:22.998472 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-260b4a8d-fdeb-4684-be3a-6644b4b7a12d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.141737 Oct 28 16:01:22.999033 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1065/2163] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:22 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:23.086480 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:23.087195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:23.093496 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:23.093944 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:23.094705 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:23.095141 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:23.217032 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:23.224352 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-90177a13-0b7c-4455-b7e5-2319efe183f0 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.141535 Oct 28 16:01:23.226914 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1099/2164] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:23 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:23.602075 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-b67562be-535c-4977-b449-7dbef5f16761 req-02cb9b49-6c7f-4bd9-ba57-c10ab7e45593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f2498-5d9c-4037-878f-c24cd90cb742", "tag": "a691340a-69e0-472e-8e47-56231dc6a486"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:23.603613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:23.603613 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:01:23.610343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-b67562be-535c-4977-b449-7dbef5f16761 req-02cb9b49-6c7f-4bd9-ba57-c10ab7e45593 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:23.610778 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-b67562be-535c-4977-b449-7dbef5f16761 req-02cb9b49-6c7f-4bd9-ba57-c10ab7e45593 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:23.621591 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-b67562be-535c-4977-b449-7dbef5f16761 req-02cb9b49-6c7f-4bd9-ba57-c10ab7e45593 service nova] Creating event network-changed:a691340a-69e0-472e-8e47-56231dc6a486 for instance 618f2498-5d9c-4037-878f-c24cd90cb742 on hv-cinder-78364 Oct 28 16:01:23.627229 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-b67562be-535c-4977-b449-7dbef5f16761 req-02cb9b49-6c7f-4bd9-ba57-c10ab7e45593 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028097 Oct 28 16:01:23.627786 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1066/2165] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:24.015485 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:24.016312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:24.022556 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:24.022984 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:24.023786 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:24.024214 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:24.150621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:24.158183 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-f02fce8b-7a3b-4d2c-93b6-5e6717880e25 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.146528 Oct 28 16:01:24.159074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1100/2166] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:24 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:24.243269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:24.243958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:24.250958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:24.251386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:24.252134 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:24.252584 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:24.370421 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:24.378195 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-875df41e-c11b-4bb8-b031-d20056766313 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.138875 Oct 28 16:01:24.378752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1067/2167] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:24 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:25.174755 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:25.175370 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:25.181774 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:25.182221 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:25.182978 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:25.183413 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:25.301760 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:25.309245 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d074e287-438e-4f24-8c73-f0eb6e4f48f8 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.138155 Oct 28 16:01:25.309846 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1101/2168] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:25 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:25.394224 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:25.394851 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:25.401022 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:25.401459 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:25.402742 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:25.403170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:25.528540 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:25.535763 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-25a43ef6-29a6-4a37-bb02-2cfb3be63ec4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.145054 Oct 28 16:01:25.536319 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1068/2169] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:25 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:26.326514 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:26.327128 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:26.333066 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:26.333504 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:26.334253 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:26.334673 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:26.453387 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:26.460669 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-bffe1ed6-4cb8-4f8f-8e56-9037b37f236e tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.138823 Oct 28 16:01:26.461237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1102/2170] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:26 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:26.552547 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:26.553150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:26.559941 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:26.560377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:26.561150 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:26.561580 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:26.680005 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:26.687158 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-de2cbd47-e21a-473d-98c0-e5ddb7ac70f8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.138218 Oct 28 16:01:26.687708 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1069/2171] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:26 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:27.476559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:27.477198 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:27.484036 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:27.484510 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:27.485272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:27.485709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:27.606312 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:27.613691 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-dc9afa76-3f0e-41e7-bf95-76b0248667d0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.140785 Oct 28 16:01:27.614230 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1103/2172] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:27 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:27.703898 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:27.704528 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:27.710770 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:27.711204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:27.711952 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:27.712374 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:27.835281 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:27.843157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-a83fbae3-87f8-4eda-95f7-ee6ec43c5b25 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.142838 Oct 28 16:01:27.843712 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1070/2173] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:27 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:28.466156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-f768fe0b-5fa7-4d8a-83b1-2c647a2d2391 req-ba4f1cca-d6a4-46d8-a4c1-ef209b3f6455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f2498-5d9c-4037-878f-c24cd90cb742", "name": "network-vif-plugged", "status": "completed", "tag": "a691340a-69e0-472e-8e47-56231dc6a486"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:28.467681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:28.467681 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:01:28.474463 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f768fe0b-5fa7-4d8a-83b1-2c647a2d2391 req-ba4f1cca-d6a4-46d8-a4c1-ef209b3f6455 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:28.474903 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-f768fe0b-5fa7-4d8a-83b1-2c647a2d2391 req-ba4f1cca-d6a4-46d8-a4c1-ef209b3f6455 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:28.486338 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-f768fe0b-5fa7-4d8a-83b1-2c647a2d2391 req-ba4f1cca-d6a4-46d8-a4c1-ef209b3f6455 service nova] Creating event network-vif-plugged:a691340a-69e0-472e-8e47-56231dc6a486 for instance 618f2498-5d9c-4037-878f-c24cd90cb742 on hv-cinder-78364 Oct 28 16:01:28.491195 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-f768fe0b-5fa7-4d8a-83b1-2c647a2d2391 req-ba4f1cca-d6a4-46d8-a4c1-ef209b3f6455 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028701 Oct 28 16:01:28.491764 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1104/2174] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 16:01:28.629095 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:28.629695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:28.635889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:28.636341 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:28.637118 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:28.637539 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:28.756732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:28.764371 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c6ff327c-9e97-42d9-ac14-59305c2a0be3 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.138770 Oct 28 16:01:28.765376 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1071/2175] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:28 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:28.860840 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:28.861535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:28.867484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:28.867925 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:28.868699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:28.869126 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:28.990952 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:28.998097 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-47ea0028-2b55-4fce-a28c-c683a7d559cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.141234 Oct 28 16:01:28.998653 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1105/2176] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:28 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:29.781675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:29.782282 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:29.788966 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:29.789350 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:29.790109 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:29.790549 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:29.909958 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:29.917384 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-49958cb1-16e8-41b2-9200-9c47918ef5e7 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.140106 Oct 28 16:01:29.918494 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1072/2177] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:29 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:30.015272 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:30.015886 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:30.022122 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:30.022566 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:30.023323 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:30.023751 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:30.140921 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:30.148100 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-ff440113-bd7f-4605-a777-3443720dd6f9 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1313 microversion: 2.1 time: 0.137009 Oct 28 16:01:30.148688 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1106/2178] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:30 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:30.934752 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:30.935364 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:30.941249 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:30.941689 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:30.942465 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:30.942889 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:31.067312 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:31.074542 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-6e60bd33-03d3-4871-b889-5624d13fbf44 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.143996 Oct 28 16:01:31.075106 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1073/2179] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:30 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:31.165535 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:31.166167 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:31.172683 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:31.173118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:31.173864 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:31.174290 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:31.292152 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:31.300047 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-30c4353d-d0c2-4d58-9b31-7715e9d70cd8 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1496 microversion: 2.1 time: 0.138506 Oct 28 16:01:31.300641 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1107/2180] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:31 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1496 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:32.031042 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:32.031536 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:32.037695 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.038405 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.039170 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.039598 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.064332 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 16:01:32.091061 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:32.091699 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:32.097586 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.098016 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.098778 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.099212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.215983 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:32.223333 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-df5c894b-26bf-45f1-af11-b4611b352c19 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.135965 Oct 28 16:01:32.223904 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1108/2181] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:32 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:32.293139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-b2d16aa8-5d49-4322-9341-7ee5a5a92b42 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "DELETE /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 204 len: 0 microversion: 2.1 time: 0.264795 Oct 28 16:01:32.293686 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1074/2182] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 16:01:32 2021] DELETE /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 16:01:32.302088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:32.302985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:32.309452 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.309896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.310655 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.311076 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.432659 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:32.440575 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e820af7a-b9b2-4f3e-bf4d-073f9de238cb tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1502 microversion: 2.1 time: 0.142412 Oct 28 16:01:32.441139 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1109/2183] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:32 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1502 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:32.523660 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-e6fe8ff3-c7ce-4ccf-ae62-83b7a2f8d29f req-35912790-e001-482c-8261-767c5ab600bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3856be1-712a-4d20-9dff-7a8c2b3b55ea", "name": "network-vif-plugged", "status": "completed", "tag": "54e381b5-364e-48b6-8ae8-1dc4b7287dcd"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:32.525386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:32.525386 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:01:32.535358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e6fe8ff3-c7ce-4ccf-ae62-83b7a2f8d29f req-35912790-e001-482c-8261-767c5ab600bb service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:32.535358 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-e6fe8ff3-c7ce-4ccf-ae62-83b7a2f8d29f req-35912790-e001-482c-8261-767c5ab600bb service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:32.546300 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-e6fe8ff3-c7ce-4ccf-ae62-83b7a2f8d29f req-35912790-e001-482c-8261-767c5ab600bb service nova] Creating event network-vif-plugged:54e381b5-364e-48b6-8ae8-1dc4b7287dcd for instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea on hv-cinder-78364 Oct 28 16:01:32.551193 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-e6fe8ff3-c7ce-4ccf-ae62-83b7a2f8d29f req-35912790-e001-482c-8261-767c5ab600bb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Oct 28 16:01:32.551764 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1075/2184] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:33.239805 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:33.240440 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:33.247300 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:33.247746 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:33.248582 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:33.249012 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:33.366471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:33.374263 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-a09aa0ed-cbf1-43db-b0fb-f2e94b191dc2 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.138144 Oct 28 16:01:33.374814 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1110/2185] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:33 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:33.458016 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:33.458700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:33.465682 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:33.466118 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:33.466876 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:33.467304 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:33.585428 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:33.593139 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-ea4c70db-2c90-47fe-839f-0a4ab0455ac6 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1502 microversion: 2.1 time: 0.139100 Oct 28 16:01:33.593707 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1076/2186] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:33 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1502 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:34.391421 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:34.392026 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:34.398243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:34.398687 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:34.399448 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:34.399875 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:34.526393 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:34.534180 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d7aabb7f-5b05-49fc-a1fc-f59b3cdc362d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1265 microversion: 2.1 time: 0.146501 Oct 28 16:01:34.534962 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1111/2187] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:34 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:34.609541 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:34.610089 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:34.616447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:34.616894 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:34.617661 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:34.618090 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:34.740576 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:34.758165 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c0f3647c-9444-4865-bffd-2514a594efd5 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1502 microversion: 2.1 time: 0.152664 Oct 28 16:01:34.759362 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1077/2188] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:34 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:34.803936 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-722a8d59-b003-445e-ac28-4bbd218012a9 req-d3df2429-1596-412c-a649-77743792ab41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f2498-5d9c-4037-878f-c24cd90cb742", "name": "network-vif-deleted", "tag": "a691340a-69e0-472e-8e47-56231dc6a486"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:34.805456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:34.805456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:01:34.812716 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-722a8d59-b003-445e-ac28-4bbd218012a9 req-d3df2429-1596-412c-a649-77743792ab41 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:34.814238 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-722a8d59-b003-445e-ac28-4bbd218012a9 req-d3df2429-1596-412c-a649-77743792ab41 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:34.823471 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-722a8d59-b003-445e-ac28-4bbd218012a9 req-d3df2429-1596-412c-a649-77743792ab41 service nova] Creating event network-vif-deleted:a691340a-69e0-472e-8e47-56231dc6a486 for instance 618f2498-5d9c-4037-878f-c24cd90cb742 on hv-cinder-78364 Oct 28 16:01:34.828605 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-722a8d59-b003-445e-ac28-4bbd218012a9 req-d3df2429-1596-412c-a649-77743792ab41 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028118 Oct 28 16:01:34.829179 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1112/2189] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:01:35.551926 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:35.552557 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:35.559287 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.559772 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.560615 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.569737 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.681377 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:35.688609 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-185a77c5-a6b4-4cd6-bd5c-cba9cd8c901d tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1452 microversion: 2.1 time: 0.140416 Oct 28 16:01:35.689166 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1078/2190] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:35 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:01:35.705378 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:35.706088 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:35.712400 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.712854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.713645 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.714074 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.774757 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:35.775561 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:35.781827 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.782270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.783028 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.783457 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.814409 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:35.814849 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:35.817097 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lazy-loading 'fault' on Instance uuid 618f2498-5d9c-4037-878f-c24cd90cb742 {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 16:01:35.848997 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:35.857173 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-cc8ab147-c3f3-4647-8656-01188f69fe2f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1452 microversion: 2.1 time: 0.156305 Oct 28 16:01:35.858019 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1113/2191] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:35 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:01:35.864412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e60eeea68db414e9c9789632766d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c39d86c23b4d46855dca8657c1356d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:01:35.881754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-466fa524-dab5-4576-9c02-4f8a6b1085e4 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 200 len: 1303 microversion: 2.1 time: 0.100149 Oct 28 16:01:35.881754 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1079/2192] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:35 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:01:36.889709 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:01:36.890243 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] [instance: 618f2498-5d9c-4037-878f-c24cd90cb742] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:01:36.897212 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:36.902314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:36.902314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:36.902314 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:36.913862 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] HTTP exception thrown: Instance 618f2498-5d9c-4037-878f-c24cd90cb742 could not be found. Oct 28 16:01:36.914458 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] Returning 404 to user: Instance 618f2498-5d9c-4037-878f-c24cd90cb742 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:01:36.915331 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-b6ba29ac-2996-4eeb-afaa-86133eb47b20 tempest-VolumesActionsTest-1378536730 tempest-VolumesActionsTest-1378536730-project] 10.222.0.86 "GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742" status: 404 len: 111 microversion: 2.1 time: 0.029793 Oct 28 16:01:36.915897 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1114/2193] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:01:36 2021] GET /compute/v2.1/servers/618f2498-5d9c-4037-878f-c24cd90cb742 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 16:01:38.093391 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-39e6b1c9-dc8a-4ae1-bd4e-3b8c71a05653 req-f1ebdb11-722a-4557-b4e5-5908b55422a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3856be1-712a-4d20-9dff-7a8c2b3b55ea", "tag": "54e381b5-364e-48b6-8ae8-1dc4b7287dcd"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:01:38.095251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:01:38.095251 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:01:38.102687 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-39e6b1c9-dc8a-4ae1-bd4e-3b8c71a05653 req-f1ebdb11-722a-4557-b4e5-5908b55422a6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:01:38.103245 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-39e6b1c9-dc8a-4ae1-bd4e-3b8c71a05653 req-f1ebdb11-722a-4557-b4e5-5908b55422a6 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:01:38.116738 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-39e6b1c9-dc8a-4ae1-bd4e-3b8c71a05653 req-f1ebdb11-722a-4557-b4e5-5908b55422a6 service nova] Creating event network-changed:54e381b5-364e-48b6-8ae8-1dc4b7287dcd for instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea on hv-cinder-78364 Oct 28 16:01:38.121390 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-39e6b1c9-dc8a-4ae1-bd4e-3b8c71a05653 req-f1ebdb11-722a-4557-b4e5-5908b55422a6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032032 Oct 28 16:01:38.122343 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1080/2194] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:01:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:02:40.754792 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:02:40.755857 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 16:02:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:03:03.466495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:03:03.467078 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 16:03:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:03:42.100539 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] AMQP server on 10.222.0.86:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 16:03:42.103225 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 16:03:42.104093 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:42.104621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:42.111069 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:42.111396 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:42.112158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:42.112668 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:42.138528 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Going to try to terminate instance {{(pid=116431) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 16:03:42.307233 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [req-6ef04b6a-d79d-4e0f-af32-87be6b5d4248 req-d8a1ca55-c868-43ef-838a-8ba6ae1ecc10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3856be1-712a-4d20-9dff-7a8c2b3b55ea", "tag": "54e381b5-364e-48b6-8ae8-1dc4b7287dcd"}]} {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:03:42.308779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:03:42.308779 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: warnings.warn(msg) Oct 28 16:03:42.315723 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6ef04b6a-d79d-4e0f-af32-87be6b5d4248 req-d8a1ca55-c868-43ef-838a-8ba6ae1ecc10 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:42.316160 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [req-6ef04b6a-d79d-4e0f-af32-87be6b5d4248 req-d8a1ca55-c868-43ef-838a-8ba6ae1ecc10 service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:42.327545 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.compute.server_external_events [req-6ef04b6a-d79d-4e0f-af32-87be6b5d4248 req-d8a1ca55-c868-43ef-838a-8ba6ae1ecc10 service nova] Creating event network-changed:54e381b5-364e-48b6-8ae8-1dc4b7287dcd for instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea on hv-cinder-78364 Oct 28 16:03:42.333107 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [req-6ef04b6a-d79d-4e0f-af32-87be6b5d4248 req-d8a1ca55-c868-43ef-838a-8ba6ae1ecc10 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231664 Oct 28 16:03:42.333854 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1081/2195] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:03:42.410634 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-5e5f399b-bdf7-4d44-8e8b-261344609f24 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "DELETE /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 204 len: 0 microversion: 2.1 time: 0.312393 Oct 28 16:03:42.411806 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1115/2196] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 16:03:42 2021] DELETE /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 16:03:42.420565 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:42.421270 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:42.427917 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:42.428363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:42.429216 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:42.429648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:42.559415 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:42.569955 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9d691c9b-62cf-4473-a71c-de9491f48509 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1576 microversion: 2.1 time: 0.153606 Oct 28 16:03:42.572639 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1082/2197] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:42 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:43.590454 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:43.591138 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:43.608484 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:43.608867 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:43.609616 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:43.610034 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:43.627798 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59bc3cd9-3439-4402-8777-d7549aa129a3] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 57518. Oct 28 16:03:43.785035 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:43.792532 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-e7384603-b14d-4fca-a9a7-26b3d224b5a0 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1458 microversion: 2.1 time: 0.206064 Oct 28 16:03:43.793118 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1116/2198] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:43 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:44.809700 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:44.810451 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:44.827567 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:44.828120 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:44.829026 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:44.829532 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:44.837125 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] [a34d6389-caa9-47e2-aea5-4275eb978750] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 57522. Oct 28 16:03:44.962128 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:44.969816 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-abe7fd63-932b-4516-86db-e55856642d65 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1458 microversion: 2.1 time: 0.164037 Oct 28 16:03:44.970506 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1083/2199] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:44 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:44.986908 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-801db5d8-85c1-4339-947c-400042c40799 req-752719b4-3d0f-4175-a381-a0cee3ca50ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3856be1-712a-4d20-9dff-7a8c2b3b55ea", "name": "network-vif-deleted", "tag": "54e381b5-364e-48b6-8ae8-1dc4b7287dcd"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:03:44.988462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:03:44.988462 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:03:44.996217 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-801db5d8-85c1-4339-947c-400042c40799 req-752719b4-3d0f-4175-a381-a0cee3ca50ef service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:44.999147 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-801db5d8-85c1-4339-947c-400042c40799 req-752719b4-3d0f-4175-a381-a0cee3ca50ef service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:45.007967 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-801db5d8-85c1-4339-947c-400042c40799 req-752719b4-3d0f-4175-a381-a0cee3ca50ef service nova] Creating event network-vif-deleted:54e381b5-364e-48b6-8ae8-1dc4b7287dcd for instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea on hv-cinder-78364 Oct 28 16:03:45.012896 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-801db5d8-85c1-4339-947c-400042c40799 req-752719b4-3d0f-4175-a381-a0cee3ca50ef service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029649 Oct 28 16:03:45.013475 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1117/2200] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:03:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:03:45.986510 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:45.987176 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:45.993412 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:45.998316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:45.998316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:45.998316 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:46.025200 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:46.025648 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:46.026127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.objects.instance [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lazy-loading 'fault' on Instance uuid a3856be1-712a-4d20-9dff-7a8c2b3b55ea {{(pid=116432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 16:03:46.070269 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:46.078108 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-f219cce8-2dec-407a-8c49-75d68231f88f tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 200 len: 1230 microversion: 2.1 time: 0.095251 Oct 28 16:03:46.078655 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1084/2201] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:45 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:47.095754 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:47.096483 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: a3856be1-712a-4d20-9dff-7a8c2b3b55ea] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:47.102598 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:47.103042 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:47.103797 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:47.104231 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:47.117402 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] HTTP exception thrown: Instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea could not be found. Oct 28 16:03:47.117985 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Returning 404 to user: Instance a3856be1-712a-4d20-9dff-7a8c2b3b55ea could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:03:47.118830 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-80e44a1b-7a5b-4438-bc8a-93fa2d1c4b69 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea" status: 404 len: 111 microversion: 2.1 time: 0.027584 Oct 28 16:03:47.119351 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1118/2202] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:47 2021] GET /compute/v2.1/servers/a3856be1-712a-4d20-9dff-7a8c2b3b55ea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 16:03:50.507953 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:50.508807 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:50.510271 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-4db0bf44-45ed-402a-836c-b368eea26e37 req-f2e09780-d5f6-4c1a-a620-a2f2429b207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa42a1d8-69f0-474f-bc4b-28f968884724", "tag": "4d937f17-5f48-4b5c-bbbd-e44c57308ea1"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:03:50.512237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:03:50.512237 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:03:50.515606 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:50.516061 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:50.516922 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:50.517436 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:50.519254 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-4db0bf44-45ed-402a-836c-b368eea26e37 req-f2e09780-d5f6-4c1a-a620-a2f2429b207e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:50.519689 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-4db0bf44-45ed-402a-836c-b368eea26e37 req-f2e09780-d5f6-4c1a-a620-a2f2429b207e service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:50.532456 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-4db0bf44-45ed-402a-836c-b368eea26e37 req-f2e09780-d5f6-4c1a-a620-a2f2429b207e service nova] Creating event network-changed:4d937f17-5f48-4b5c-bbbd-e44c57308ea1 for instance aa42a1d8-69f0-474f-bc4b-28f968884724 on hv-cinder-78364 Oct 28 16:03:50.537446 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-4db0bf44-45ed-402a-836c-b368eea26e37 req-f2e09780-d5f6-4c1a-a620-a2f2429b207e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Oct 28 16:03:50.538876 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1119/2203] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:03:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 16:03:50.543452 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Going to try to terminate instance {{(pid=116432) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 16:03:50.837453 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-9f2536f2-b48c-4d6c-bc8d-a5bf30b456dc tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "DELETE /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 204 len: 0 microversion: 2.1 time: 0.333240 Oct 28 16:03:50.839157 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1085/2204] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 16:03:50 2021] DELETE /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 16:03:50.847524 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:50.848250 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:50.855156 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:50.855559 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:50.856330 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:50.856793 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:50.985341 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.policy [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116431) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:50.993735 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-67ece670-9ad8-4fb8-ae1d-118c7bebd614 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1576 microversion: 2.1 time: 0.150139 Oct 28 16:03:50.998946 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1120/2205] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:50 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 16:03:52.011388 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:52.012085 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:52.018284 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:52.018732 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:52.019517 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:52.019951 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:52.150387 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:52.157627 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c19ea2df-814e-4dfd-b640-dfe73db69085 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1457 microversion: 2.1 time: 0.150225 Oct 28 16:03:52.158182 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1086/2206] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:52 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1457 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:52.734219 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [req-78b65854-b567-4347-b180-bd31335eef36 req-dd7377bd-c496-486f-9014-373b229e90ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa42a1d8-69f0-474f-bc4b-28f968884724", "name": "network-vif-deleted", "tag": "4d937f17-5f48-4b5c-bbbd-e44c57308ea1"}]} {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 16:03:52.735721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 16:03:52.735721 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: warnings.warn(msg) Oct 28 16:03:52.743414 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-78b65854-b567-4347-b180-bd31335eef36 req-dd7377bd-c496-486f-9014-373b229e90ad service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:52.743854 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [req-78b65854-b567-4347-b180-bd31335eef36 req-dd7377bd-c496-486f-9014-373b229e90ad service nova] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:52.757557 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.compute.server_external_events [req-78b65854-b567-4347-b180-bd31335eef36 req-dd7377bd-c496-486f-9014-373b229e90ad service nova] Creating event network-vif-deleted:4d937f17-5f48-4b5c-bbbd-e44c57308ea1 for instance aa42a1d8-69f0-474f-bc4b-28f968884724 on hv-cinder-78364 Oct 28 16:03:52.762354 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [req-78b65854-b567-4347-b180-bd31335eef36 req-dd7377bd-c496-486f-9014-373b229e90ad service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 Oct 28 16:03:52.762929 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1121/2207] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Oct 28 16:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 16:03:53.174756 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:53.175363 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:53.182414 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:53.182860 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:53.183628 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:53.184062 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:53.243342 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.policy [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad9a2338a304b39a34043a140a6a367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9909723fa66c47a1a813ac7796204744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116432) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 16:03:53.250638 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-32c9efc7-0c0e-4eb7-824c-1cc96fbf7b57 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 200 len: 1225 microversion: 2.1 time: 0.079543 Oct 28 16:03:53.251191 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1087/2208] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:53 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 16:03:54.268801 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:54.269495 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: aa42a1d8-69f0-474f-bc4b-28f968884724] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:54.276739 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:54.277695 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:54.278633 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:54.279373 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:54.293649 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] HTTP exception thrown: Instance aa42a1d8-69f0-474f-bc4b-28f968884724 could not be found. Oct 28 16:03:54.294235 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Returning 404 to user: Instance aa42a1d8-69f0-474f-bc4b-28f968884724 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:03:54.295048 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-d8620d9e-d40f-4ab5-9974-6503f7ce7337 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724" status: 404 len: 111 microversion: 2.1 time: 0.030835 Oct 28 16:03:54.295577 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1122/2209] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:54 2021] GET /compute/v2.1/servers/aa42a1d8-69f0-474f-bc4b-28f968884724 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 16:03:55.020168 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:55.020702 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.compute.api [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116432) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:55.028179 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:55.028672 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:55.029432 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:55.029866 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG oslo_concurrency.lockutils [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:55.042862 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.wsgi [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] HTTP exception thrown: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. Oct 28 16:03:55.043447 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Returning 404 to user: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. {{(pid=116432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:03:55.044258 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-0cee066f-1ce8-4b42-9683-789a8e8b7d84 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "DELETE /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 404 len: 111 microversion: 2.1 time: 0.027904 Oct 28 16:03:55.044811 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1088/2210] 10.222.0.86 () {58 vars in 1238 bytes} [Thu Oct 28 16:03:55 2021] DELETE /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 16:03:55.052554 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '>' {{(pid=116431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:55.053158 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.compute.api [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] [instance: ecfea674-92fa-46b4-9ea8-ed35e5f207b5] Fetching instance by UUID {{(pid=116431) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 16:03:55.058878 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:55.059320 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:55.060067 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 16:03:55.060537 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG oslo_concurrency.lockutils [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Lock "860507c8-0e7d-40f5-a3f0-4d31c653347c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 16:03:55.075569 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.wsgi [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] HTTP exception thrown: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. Oct 28 16:03:55.076155 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: DEBUG nova.api.openstack.wsgi [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Returning 404 to user: Instance ecfea674-92fa-46b4-9ea8-ed35e5f207b5 could not be found. {{(pid=116431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 16:03:55.076998 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO nova.api.openstack.requestlog [None req-14c66c98-d3a6-40d1-8e2a-5fd0945e5228 tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5" status: 404 len: 111 microversion: 2.1 time: 0.028050 Oct 28 16:03:55.077526 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: [pid: 116431|app: 0|req: 1123/2211] 10.222.0.86 () {58 vars in 1235 bytes} [Thu Oct 28 16:03:55 2021] GET /compute/v2.1/servers/ecfea674-92fa-46b4-9ea8-ed35e5f207b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 16:03:56.553183 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: DEBUG nova.api.openstack.wsgi [None req-c9686d6f-f64e-45a3-9fe3-0535e138ab1b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] Calling method '.version_select at 0x7fdc1825f5e0>' {{(pid=116432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 16:03:56.637127 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO nova.api.openstack.requestlog [None req-c9686d6f-f64e-45a3-9fe3-0535e138ab1b tempest-TestVolumeBootPattern-1619207167 tempest-TestVolumeBootPattern-1619207167-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-378413968" status: 202 len: 0 microversion: 2.1 time: 0.090418 Oct 28 16:03:56.637728 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: [pid: 116432|app: 0|req: 1089/2212] 10.222.0.86 () {58 vars in 1259 bytes} [Thu Oct 28 16:03:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-378413968 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 16:04:13.599467 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:04:13.600204 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 16:04:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:04:20.377098 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:04:20.377666 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 16:04:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:06:23.483384 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:06:23.484700 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 16:06:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:06:36.142621 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:06:36.143190 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 16:06:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:07:33.617521 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:07:33.618117 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 16:07:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:07:40.394176 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:07:40.394762 dv-cinder-783643-3-iscsi devstack@n-api.service[116431]: Thu Oct 28 16:07:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:09:20.783675 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:09:20.784172 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 16:09:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 16:09:30.140470 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 16:09:30.141601 dv-cinder-783643-3-iscsi devstack@n-api.service[116432]: Thu Oct 28 16:09:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!